Image processing method, an image processing apparatus, an image input device, a photographing device, a photographing system, a communication device, a communication system, and a storage medium

ABSTRACT

A method for processing images comprises the steps of performing the reception of data through the net work, inputting image data obtainable in accordance with the designated input mode, managing the storage of the data received in the receiving step and the image data inputted in the input step to the memory, and intervening between the operations of the reception step and the input step in accordance with the storage management in the controlling step. With the method thus structured, the compression ratio of the input image is heightened by changing the current photographing mode if the added value of the estimated reception data through communicating means and the data side of photographed image predetermined by the current photographing mode should exceed the remainders of memory in the storage, hence making it possible to implement the compatibility of immediacy between the image input and the communication by dealing with any sudden reception during photographing.

BACKGROUND OF THE INVENTION

[0001] 1. Field of the Invention

[0002] The present invention relates to a digital camera and the like.More particularly, the invention relates to an image input device, aphotographing device, and photographing system, which are provided withcommunicating functions, and a communication device, and a communicationsystem, which perform transmission and reception of images or the like.The invention also relates to a storage medium that stores processingsteps readable by a computer for controlling the operations of theapparatuses, devices, or systems.

[0003] 2. Related Background Art

[0004] Along with the technical advancement of semiconductor and others,the pluralization of digital cameras has been remarkable in recentyears. The digital camera digitizes photographed images and stores themon the image memory. For an image memory of the kind, a semiconductorstorage is often used in particular.

[0005] However, since the semiconductor storage is extremely expensive,there is automatically a limit as to the capacity of the semiconductorstorage that may be adoptable for a digital camera in consideration ofthe overall costs of the digital camera to be used. In other words, thenumber of photographs that can be taken is limited. At present, thestandard capacity of the semiconductor storage provided for a digitalcameral is not large enough for the photographing frequency usuallyanticipated for a camera equipment.

[0006] Now, for example, there is a digital camera that uses anexchangeable storage device, such as a PCMCIA flash memory card, a smartmemory, so that the number of photographs taken by such camera isincreased by allowing the user to exchange the image storage inaccordance with his requirement.

[0007] Conceivably, however, there is a case where no image storage isobtainable anew when the user wishes to replace the storage that hasbecome full. As a result, the user should estimate the number ofphotographs that he may wish to take beforehand, and bring with him thePCMCIA flash memory cards or the like with a sufficient room for suchestimated number.

[0008] Also, in order to secure the sufficient number of photographsthat may be taken in anticipation of the general photographing frequencyneeded for the camera equipment described above, it may be possible touse some other media than the semiconductor storage, such as a hard discor other magnetic storage.

[0009] Nevertheless, even if a magnetic storage is used as the imagememory, its capacity is not infinite. There is naturally a limit to it.

[0010] Therefore, the number of photographs that may be taken by theaforesaid digital camera is confined depending on the capacity of thebuilt-in image storage or the availability of the exchangeable storagedevice. Under such circumstances, if pictures should be taken on thephotographing site in the numbers beyond such limit, for example, it isnecessary to erase the unwanted pictures that have been taken and storedon the image storage or transfer the stored images to the storage deviceor the like in a personal computer. With an operation of the kind, it ispossible to increase the capacity of the image storage for use.

[0011] However, the requirement of such operation as described abovethat should be carried out on the photographing site results in the timeloss inevitably, and this becomes a significant drawback in using adigital camera for which immediacy is essential.

[0012] More specifically, when an unwanted picture should be erased fromamong the images that have been photographed, it is imperative toconfirm various pieces of information to determine which one of them canbe discarded. Making such confirmation exactly becomes a great burden onthe photographer. In some cases, it is not easy to determine whether ornot the photographed image is readily usable through the small displayscreen generally provided for a digital camera.

[0013] Further, in order to implement the aforesaid confirmation to bemade efficiently, there is a need for the provision of a new group ofoperational switches or a display screen dedicated for the confirmationuse. This may stand in the way of making the digital camera smaller.

[0014] Furthermore, it presents a psychological burden on thephotographer eventually if any one of the images that he has takenshould be erased on the photographing site. To such operation asdescribed above, therefore, his sense of denial should be intense.

[0015] On the other hand, when the photographed images are transferredto the storage device in a personal computer, such burdens as describedabove are not imposed upon the photographer, but the interface or thelike to perform such transfer between the digital camera and thepersonal computer should be carried around with the photographer. As aresult, the physical burden becomes greater on his side.

[0016] Here, therefore, in order to solve the above problems, it isconceivable to provide a digital cameral with communicating functions,for example, so that the photographed images or electronic mails aretransmitted or received as required.

[0017] Nevertheless, with a digital camera that may be structured toenable it to operate communications, the collision of requests may takeplace on a memory if one and the same memory is used to storephotographed images and the data on transmission and reception. Then,there will be created the problem anew that may have not beenencountered with the digital camera which is provided only with thephotographing functions. For example, if the memory which is intended tobe used for the storage of a photographed image should be occupied bythe receiving data by the reception call of communication on the verymoment the photographer is about to take a picture, the photographingwhich has been possible up to that moment is no longer executable.

[0018] In order to avoid a problem of the kind, the photographer isrequired to determine on the site whether or not such communicationshould be received on the moment a communication call is notified. Then,it becomes impossible to maintain the immediacy of photography, andthere is a good possibility that a shutter chance is lost eventually. Aproblem of the kind presents a significant drawback in using a digitalcamera.

[0019] Also, it is conceivable that the reception data is not storedcompletely up to the end if the photographing function should operatewhile in communication. This may produce unfavorable effect on thereliability of communication. As a result, it may also present asignificant drawback in using a digital camera which is provided withthe communicating function.

SUMMARY OF THE INVENTION

[0020] The present invention is designed in consideration of theproblems described above. It is an object of the invention to solve allor at least one of the problems.

[0021] It is another object of the invention to make the restrictionssmaller on the functions of the apparatus due to the capacity of itsstorage.

[0022] It is still another object of the invention to avoid marring theimmediacy of image recording. It is a further object of the invention toprovide an image input device, a photographing device, a communicationdevice, a communication system, and a storage medium that stores theprocessing steps readable by a computer for the operational control ofthe apparatuses, devices, or systems, which make it possible to providea digital camera whose performance is enhanced while being capable ofmaintaining its smallness and the immediacy of photography.

[0023] In order to achieve the above-mentioned objects, one embodimentof the present invention discloses a method for processing imagescomprising the steps of performing the reception of data through the network; inputting image data obtained in accordance with the designatedinput mode; managing the storage of the data received in the receivingstep and the image data inputted in the input step to the memory; andintervening between the operations of the reception step and the inputstep on the basis of the storage management in the managing step.

[0024] In this way, it becomes possible to deal with any suddenreception or the like during the storing operation of the image data onthe memory, because the data reception operation and the image inputoperation can be controlled in accordance with the current status ofmemory storage. As a result, the compatibility of immediacy can beimplemented between the image input and the communication.

[0025] Also, the aforesaid reception step further comprises the step ofreceiving data through wireless net work.

[0026] Thus, it is possible to deal with the communication through thewireless net work.

[0027] Also, the aforesaid intervening step further comprises thecontrol step of controlling the input mode in the input step inaccordance with the storage management in the management step.

[0028] In this way, it becomes possible to control the storing operationof the image data on the memory by changing the current input modes inaccordance with the status of the memory storage.

[0029] Also, the aforesaid input step further comprises an imageinreversible compression step, and the intervening step furthercomprises a control step for controlling the compression ratio in thecompression step.

[0030] In this way, it becomes possible to control the amount of imagedata to be stored on the memory by changing the compression ratios inaccordance with the status of the memory storage.

[0031] Moreover, the aforesaid management step further comprises a stepof managing the remaining storage capacity of the memory.

[0032] Hence, it is possible to control the data reception operation andthe image input operation in accordance with the remainders (remainingamount) of the storage capacity of the memory.

[0033] It is still another object of the present invention to provide aphotographing apparatus having new functions, a communicating device, ora storage medium for the execution of the functions of such apparatus byuse of a computer.

[0034] Other objectives and advantages besides those discussed abovewill be apparent to those skilled in the art from the description of apreferred embodiment of the invention which follows. In the description,reference is made to accompanying drawings, which form a part hereof,and which illustrate an example of the invention. Such example, however,is not exhaustive of the various embodiments of the invention, andtherefore, reference is made to the claims which follow the descriptionfor determining the scope of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

[0035]FIG. 1 is a view which shows the outer appearance of the front ofa digital camera that executes a method for processing images inaccordance with a first embodiment of the present invention.

[0036]FIG. 2 is a view which shows the outer appearance of the digitalcamera represented in FIG. 1, observed from the aspect other than thefront side.

[0037]FIG. 3 is a view which illustrates the mode dials of the digitalcamera represented in FIG. 1.

[0038]FIG. 4 is a view which illustrates each of the functions of thedigital camera represented in FIG. 1.

[0039]FIG. 5 is a block diagram which shows the inner structure of thedigital camera represented in FIG. 1.

[0040]FIG. 6 is a block diagram which shows the details of the structureof the camera unit of the digital camera represented in FIG. 1.

[0041]FIG. 7 is a block diagram which shows the details of the PHS unitof the digital cameral represented in FIG. 1.

[0042]FIG. 8 is a flowchart which illustrates the program to perform thephotographing operation of the digital camera represented in FIG. 1.

[0043]FIG. 9 is a flowchart which illustrates the program to execute theinterruptive process by use of the corresponding keys for thephotographing operation represented in FIG. 8.

[0044]FIG. 10 is a flowchart which illustrates the program to executethe play back function for the interruptive process represented in FIG.9.

[0045]FIG. 11 is a flowchart which illustrates the program to executethe operation of the image reproduction (indication) for the digitalcamera represented in FIG. 1.

[0046]FIG. 12 is a flowchart which illustrates the program to executethe link establishment process of an electronic mail for the digitalcamera represented in FIG. 1.

[0047]FIG. 13 is a flowchart which illustrates the program to executethe transmission and reception processes for the electronic mailrepresented in FIG. 12.

[0048]FIG. 14 is a flowchart which illustrates the program to executethe transmission and reception processes for the electronic mailrepresented in FIG. 12.

[0049]FIG. 15 is a block diagram which conceptually shows the controlflow of the digital camera represented in FIG. 1.

[0050]FIG. 16 is a flowchart which illustrates the program to executethe control of the amount of a photographing image for the digitalcamera represented in FIG. 1.

[0051]FIG. 17 is a block diagram which conceptually shows the controlflow of the digital camera represented in FIG. 1 in accordance with asecond embodiment of the present invention.

[0052]FIG. 18 is a flowchart which illustrates the program to executethe control of the amount of receiving data for the digital camera inaccordance with the second embodiment of the present invention.

[0053]FIG. 19 is a flowchart which illustrates the program to executethe control of the amount of receiving data for the digital camerarepresented in FIG. 1 in accordance with a third embodiment of thepresent invention.

[0054]FIG. 20 is a flowchart which illustrates the program to executethe control of the amount of receiving data for the digital camerarepresented in FIG. 1 in accordance with a fourth embodiment of thepresent invention.

[0055]FIG. 21 is a flowchart which illustrates the program to executethe control of the amount of receiving data for the digital camerarepresented in FIG. 1 in accordance with a fifth embodiment of thepresent invention.

[0056]FIG. 22 is a flowchart which illustrates the program to executethe control of streaming data received by the digital camera representedin FIG. 1 in accordance with a sixth embodiment of the presentinvention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0057] Hereinafter, in conjunction with the accompanying drawings, thedescription will be made of the embodiments in accordance with thepresent invention.

[0058] (First Embodiment)

[0059] The image processing method of the present invention will beexecuted by a digital cameral shown in FIG. 1, for example.

[0060] The image processing apparatus or the image input device of thepresent invention is applicable to this digital camera 100.

[0061] Here, in accordance with the first embodiment, the digital camera100 is provided with the communicating function, such as telephone,electronic mail, and as shown in FIG. 1 (which shows the outerappearance of the apparatus), there are provided on the front of thedigital camera 100, a shutter button 102, a mode dial 101, a lens 108,and a stroboscope 108 which is arranged above the lens 108.

[0062] Also, on the side end of the digital camera 100 main body, thereare arranged a speaker 105, a black and white liquid crystal display104, a key board 103, a jog dial (not shown) which will be describedlater, and a microphone 106 incorporated in the main body of the digitalcamera.

[0063] Further, on the surface opposite to the plane where the shutterbutton 102, the mode dial 101, the lens 108, and the stroboscope 109 arearranged, a pointing device 110 is provided as shown in FIG. 2 (whichshows the outer appearance of the apparatus, observed in the directionindicated by an arrow A in FIG. 1).

[0064] Furthermore, as shown in FIG. 2, the portion where the speaker105 is provided is arranged in such a manner that it is freely openedfrom or closed to the digital camera 100 main body in the directionindicated by an arrow B. The structure is arranged so that a colorliquid crystal display 107 is made observable when this portion is open.

[0065] Here, the mode dial 101 is also provided with the power switchingfunction, and as shown in FIG. 3 (the front view of the mode dial 101,observed in the direction indicated by an arrow C in FIG. 1), this dialis structured so as to be rotative around the shutter button 102.

[0066] Then, with the rotation of this mode dial 101, it is madepossible to switch the modes in which the power-supply is turned off(OFF mode); the telephone is made ready for transmission and reception(TEL mode); the image, audio, text, and other information, which arestored in the main body of the digital camera 100, are indicated on thedisplay (VIEW mode); and some more.

[0067] Here, FIG. 4 shows the respective functions of each of the modesof the digital camera 100 represented in FIG. 1.

[0068] As shown in FIG. 4, the telephone call can be received (the TELcalled function is ready) in the modes other than the OFF mode.

[0069] In the TEL mode, the usual PHS (personal handy-phone system)telephone set becomes operative (that is, the TEL called and TEL callingfunctions are ready). In other words, it becomes possible to input atelephone number from the key board 103 on the digital camera 100 mainbody, to indicate the input number on the black and white LCD 104, andto indicate on it the telephone numbers stored in advance (the displayof a personal telephone directory) in the TEL mode. Then, thetransmission and reception of a telephone call are made by use of thespeaker 105 and the microphone 105 incorporated in the digital camera100 main body.

[0070] Also, in the TEL mode, indications are made possible on the colorLCD 107 as required so as to select any one of the complicate optionalfunctions easily by the application of color-coding or the like.

[0071] Here, the phrase “the transmission and reception of a telephonecall” means to include the data communication that may be executable byuse of the PHS telephone set, the portable telephone set, or the like.

[0072] In the VIEW mode, the arrangement is made to select either theimage obtained by photographing in the CAMERA mode which will bedescribed later, the recorded audio, the received image and audio, orthe text, and then, to reproduce any one of them or to display it (thatis, the image display/output function, audio output function, textdisplay function, and electronic mailing function).

[0073] In the CAMERA mode, although the details will be described later,the photographing object via the lens 108 is photoelectrically convertedinto the electric signals by means of the CCD (charge coupled device) orsome other photographing device, and stored on a flash memory or otherstorage device after given image processes are executed as required(that is, the image input/storage function).

[0074] Also, in the CAMERA mode, it is possible to select, by use of thepointing device 110, the condition of stroboscopic emission from amongthose on the menu shown on the color LCD 107, and to illuminate theobject under the condition thus selected.

[0075] Further, in the CAMERA mode, it is possible to confirm the imageobtained by photographing by use of the play back function which will bedescribed later, and then, to erase it if unwanted or record the audiodata as annotation (that is, the audio input/storage function), or tosend it to the desired party as the electronic mail (the electronic mailfunction).

[0076] The inner structure of such digital camera 100 as described aboveis mainly arranged with the main CPU unit 201, the sub-CPU unit 202, thePHS unit 203, and the camera unit 204 as shown in FIG. 5, for example.With the cooperative operations of each of the units, it becomespossible for the TEL mode, the VIEW mode, and the CAMERA mode to executeeach of the functions as given below.

[0077] Now, hereunder, the specific description will be made of the mainCPU unit 201, the sub-CPU unit 202, the PHS unit 203, and the cameraunit 204.

[0078] (1) Camera Unit 204

[0079]FIG. 6 is a diagram which specifically shows the camera unit 204represented in FIG. 5.

[0080] As shown in FIG. 6, the camera unit 204 comprises thephotographing device 213 where the incident light from the lens 108shown in FIG. 1 is focused into an image on the photographing plane; theCDS/AGC circuit 214 to which is supplied the output of the photographingdevice 213; the A/D converter 215 to which is supplied the output fromthe CDS/AGC circuit 214; the signal processing circuit (image processor)216 to which is supplied the output of the A/D converter 215; and thecamera microcomputer 211 which is connected with the CPU 29 (FIG. 5) ofthe main CPU unit 210 which will be described later in detail. Theoutput from the camera microcomputer 211 is supplied to the imageprocessor 216. Then, the output from the image processor 216 is suppliedto the CPU 29.

[0081] Also, the camera unit 204 is provided with the timing generator218 to which the output from the CPU 29 is supplied, and also, providedwith the vertical driver 217 to the output from the timing generator 218is supplied. The output from the timing generator 218 is supplied toeach of the photographing device 213, the CDS/AGC circuit 214, the A/Dconverter 215, and the image processor 216. The output from the verticaldriver 217 is supplied to the photographing device 213.

[0082] Further, the output from the CPU 29 is supplied to the imageprocessor 216.

[0083] In the camera unit 204 thus arranged, the camera microcomputer211 controls the entire operation of the camera unit 204 bycommunicating with the CPU 29 which controls the operation of the entirebody of the apparatus. For example, the camera microcomputer 211controls the operation of the respective image processes when receivingthe information of the lens position of the lens 108 (FIG. 1), andtransfers the information to the CPU 29 so as to prompt the user'soperation in accordance with the aperture condition.

[0084] More specifically, at first, the lens 108 is a zoom lens of thethree-time magnification, which is structured to shift the zoomingpositions manually, for example. In terms of a 35 mm camera, it has afocal length of 24 mm to 103 mm. Then, this lens position is given tothe camera microcomputer 211 by means of hole device (not shown).Therefore, in accordance with given lens positions of the lens 108, thecamera microcomputer 211 controls the operation of the camera unit 204so as to perform various image processes.

[0085] Meanwhile, as to brightness, the lens is provided with the F2.4to F3.5, and between the lens 108 and the photographing device 213,there are also provided two kinds of optical apertures, open andstop-down, although not shown in FIG. 6. These apertures are manuallyoperated. Then, the camera microcomputer 211 detects the aperturepositions to transfer the detected result to the CPU 29. Therefore, theCPU 29 is arranged to give warning or the like to the user when theamount of light is insufficient or excessive in accordance with thedetected result of the camera microcomputer 211.

[0086] Also, the stroboscope 109 is provided with the lightingadjustment circuit. The charging and light emitting are also controlledby the camera microcomputer 211. In other words, the stroboscope 109varies the reference level of the light adjusting control in accordancewith the lens positions of the lens 108 (the zoom lens) provided by thecamera microcomputer 211. Therefore, irrespective of the lens positionsof the lens 108, it is made possible to obtain an appropriate lightemission.

[0087] In this respect, the CPU 29 is, although described later indetail, formed by the IC of inclusive type having the memory controllerand serial interface in it, which controls the operation of the entirebody of the apparatus.

[0088] By the control made by the camera microcomputer 211 thusarranged, the camera unit 204 operates as given below.

[0089] At first, the clock K signal 230 generated by the CPU 29, whichis the base of the timing of the apparatus entire body, and thehorizontally and vertically synchronized signals 40 are supplied to thetiming generator (TG) 218 at the display timing of the photographingdevice 108.

[0090] The timing generator 218 generates the timing signals at which toform images on the photographing device 213. In synchronism with theclock K signal 230 and the horizontally and vertically synchronizedsignals 40 from the CPU 29, the timing generator supplies the timingsignal 226 (which is the basic timing signal for the image formation) tothe photographing device 213; the timing signal 227 (which needs thevoltage conversion given to the photographing device 213) to thevertical driver 217; the sample hold signal 231 (which is the timingsignal of the sample holding) to the CDS/AGC circuit 214; and the sampleclock 228 (which is the basic clock at which to sample the imagesignals) to the A/D converter 215 and the image processor 216,respectively.

[0091] At this time, the lens 108 converges light on the photographingplane (charged surface) of the photographing device 213 by refractinglight from the object (which is not shown) to be photographed.

[0092] The photographing device 213 is formed by CCD, for example, andthe size of the image formed by the photographing device 213 is 1,280horizontal pixels (dots) and 960 vertical pixels.

[0093] Then, the photographing device 213 converts the light from theobject on the lens 108 into electric signals (charges) in accordancewith the timing signal 226 from the timing generator 218, and suppliesthe electric signals thus converted to the CDS/AGC circuit 214 asanalogue image signals 222.

[0094] Also, the vertical driver (V-Driver) 217 converts the voltageamplitude of the signal that drives the photographing device 213 inaccordance with the timing signals 227 from the timing generator 218.

[0095] In this way, the electric signals having the 1,280 horizontalpixels and 960 vertical pixels are supplied to the CDS/AGC circuit 214as signals of the photographed image.

[0096] In accordance with the sample hold signals 231 from the timinggenerator 218, the CDS/AGC circuit 214 performs the sampling process andremoves noises from the photographed image signals 222 from thephotographing device 108. Also, the gain of the signal amplitude isautomatically controlled. Then, the CDS/AGC circuit 214 supplies thephotographed image signals 223 thus processed to the A/D converter 215.

[0097] The A/D converter 215 converts the photographed image signals(analogue pixel signals) from the CDS/AGC circuit 214 into the 10-bitdigital data 64 in accordance with the sample clock 228 from the timinggenerator 218, and supplies the digital data 224 to the image processor216 via the 10-data bus.

[0098] The image processor (signal processing circuit) 216 is an imageprocessing IC. Then, the control signals 221 from the CPU 29 are givento the image processor 216 through the camera microcomputer 211.Therefore, the image processor 216 executes the image processes, such asthe white balancing, the AE, and more by reading from or writing to theinner registers (not shown) in accordance with the control signals 221.

[0099] More specifically, the image processor 216 performs thecorrection process, such as the white balancing, for the digital datafrom the A/D converter 215 in accordance with the sample clock 228 fromthe timing generator 218. Then, the image processor converts such datafrom the color space available at the photographing device 213 to thecolor space of the RGB system, and then, makes them the image data 39 inthe YUV 8-bit format to be supplied to the CPU 29 through the 8-databus.

[0100] (2) Sub-CPU Unit 202

[0101] As shown in FIG. 5, the sub-CPU unit 202 is provided with thesub-CPU 1 which communities with the main CPU unit 201, the PHS unit203, and the camera unit 204 described above. With the sub-CPU 1, thereare connected the black and white LCD display 104, the jog dial 11, thekey board 103, the mode dial 101, the shutter button 102, the RTC 4, theDC-DC converter 24, and the battery 22.

[0102] The sub-CPU unit 202 thus arranged has the functions given below.

[0103] (2-1)

[0104] The sub-CPU 1 exchanges the commands and data by communicatingwith the CPU 29 of the main CPU unit 201.

[0105] As means for this communication, the parallel transfer isperformed by use of the bus 19 formed by 13 signals lines. The bus 19comprises an 8-data bus, a one-address signal line, an I/O READ line, anI/O WRITE line, a chip selection line, and an INTERRUPT signal line.

[0106] Also, the sub CPU 1 supplies the reset request signal Reset ofthe main CPU unit 201 to the CPU 29 through the signal line 20.

[0107] Further, the sub-CPU 1 supplies the rest request signal Rest ofthe camera unit 204 control to the camera microcomputer 51 through thesignal line 21.

[0108] (2-2)

[0109] The sub-CPU 1 communicates with the PHS module 48 of the PHS unit203 to exchange commands, data, and some more between them.

[0110] As this communication means, the serial transfer is performedusing the signal line 16 for serial data carrier signals (TxD and RxD),the signal line 17 for RING signals, and the signal line 18 for WakeUpsignals.

[0111] Also, the sub-CPU 1 supplies the rest request signal Reset to thePHS module 48 of the PHS unit 203 through the signal line 18.

[0112] (2-3)

[0113] The sub-CPU 1 controls the display operation of the black andwhite LCD 104 by serially transferring the commands, data, and the likethrough the signal line 3 for use of the CS signal, RS signal, SDAsignal, and SCL signal in order to allow the black and white LCD 104 todisplay telephone numbers and others.

[0114] Also, the sub-CPU 1 controls the ON/OFF of the back light (notshown) of the black and white LCD 104 by supplying the BL-ON signal tothe black and white LCD 104 through the signal line 3.

[0115] (2-4)

[0116] The sub-CPU 1 is connected with the RTC 4 through the I2C-BUS(Inter IC BUS: advocated by Philips Inc.).

[0117] The RTC 4 generates calendar, time, and other information. Also,the RTC 4 operates with the operation clock of 32.768 kHz, and thisoperation clock is supplied to the PHS module 48 through the signal line49.

[0118] It is arranged for the sub-CPU 1 to obtain the information ofdata, time, and some others by use of the RTC 4.

[0119] Also, the alarm signal is transmitted from the RTC 4 to theinterruption terminal IRQ of the sub-CPU 1 through the signal line 6. Inthis way, the sub-CPU 1 is ready to operate interruption process at thetime set in advance.

[0120] (2-5)

[0121] The sub-CPU 1 detects an input made by the key operation of themode dial 101, the shutter button 102, the key board 103, or the like.

[0122] In other words, the sub-CPU 1 is arranged to be able todiscriminate four modes: by detecting the current operational status ofthe mode dial 101 (mode change switch), the sub-CPU discriminates theOFF mode (the source-supply cut off mode), the TEL mode (the telephonemode), the VIEW mode (the reproduction mode), and the CAMERA mode (thecamera mode) from one another. To this end, the sub-CPU 1 is connectedwith the mode dial 101 by four signal lines (switch input terminals) 8.

[0123] Also, the sub-CPU 1 detects the operational status of the shutterbutton 102 (the shutter switch). The shutter button 102 is a two-stagedswitch which enables the button to be in the state of being halfdepressed and completely depressed, respectively. Therefore, the sub-CPU1 is arranged to determine whether the shutter button 102 is halfdepressed or completely depressed. To this end, the sub-CPU 1 and theshutter button 102 are connected by two signal lines (switch inputterminals) 10.

[0124] Also, the sub-CPU 1 detects the operational status of the jogdial 11.

[0125] The jog dial 11 is used for selecting the target item of aplurality of items indicated on the screen of the black and white LCD104. For example, the user rotates the jog dial 11 to move the cursor onthe screen of the black and white LCD 104. When the cursor is positionedon the target item, the item is determined by depressing the jog dial11. Also, the jog dial 11 is composed so as to be capable of beingswitched over on the screen of the black and white LCD 104. For example,if the jog dial is inclined to the left, the screen returns to theprevious indication. If it is inclined to the right, the screen isallowed to proceed to the next indication.

[0126] Such operational control accompanied by the operation of the jogdial 11 is performed by the sub-CPU 1 with its detection of the currentoperational status of the jog dial 11. Therefore, the sub-CPU 1 isconnected with the jog dial 11 by a total of five lines (switch inputterminals) 12, that is, two signal lines for use of discriminating tworotational directions; one signal line for use of discriminating thedepression of the jog dial; and two signal lines for use ofdiscriminating the left and right inclinations thereof.

[0127] Also, the sub-CPU 1 detects the operational status of the keyboard 103.

[0128] The key board 103 is used for inputting the telephone numbers. Itis formed by switches of 8×2 key matrix type.

[0129] Therefore, the key board 103 is scanned by the sub-CPU 1 by useof the eight output signal lines (output terminals) 14 and two inputsignal lines (input terminals) 15.

[0130] Each of the keys, such as the mode dial 101, the shutter button102, and the key board 103, among some others, is provided with aspecial input terminal which is used for interruption when any of theinputs should change. Therefore, when the sub-CPU 1 is on standbywithout any particular job to be executed, the sub-CPU 1 is allowed toshift from the standby status to the full-on status automatically if thekey input changes, and then, execute the control processes to be madefollowing such changes of input.

[0131] (2-6)

[0132] The sub-CPU 1 is connected with the battery 22 through the signalline 26. Then, by the signal line 26, serial communications are carriedout by use of the RxD. For example, the sub-CPU 1 receives the remainingamount of the cell energy from the battery 22 or information on thebattery when it has been charged (voltage, temperature, and some more),and performs the control processes in accordance with the informationthus received.

[0133] Here, the electric power of the battery 22 is given to eachsection of the sub-CPU unit 202 through the DC-DC converter 24. Then,the sub-CPU 1 conducts the power management by controlling the ON/OFF ofthe DC-DC converter 24 through the signal line (output terminal) 25.

[0134] Also, the battery 22 is provided with the attachment/detachmentdetection switch 23 which is interlocked with the knob (not shown) ofthe lid of the outlet opening for the battery 22. The detection signalsof the attachment/detachment detection switch 23 is supplied to thesub-CPU 1 through the communication line 27. The sub-CPU 1 is arrangedto sense the status where the battery 22 is about to be withdrawn by thedetection signal emitted from the attachment/detachment detection switch23, and to carry out the power off process at that time. In this way, itis arranged to prevent data and others on the memory from beingdestroyed.

[0135] Further, the output voltage of the battery 22 is supplied to thesub-CPU 1 through the signal line (A/D converter input terminal) 28.Then, the sub-CPU 1 monitors the voltage of the battery 22. If anyexcessive charging, excessive discharging, or any other abnormalcondition is detected, the corresponding protection processes areeffectuated accordingly.

[0136] (3) PHS Unit 203

[0137]FIG. 7 shows specifically the inner structure of the PHS unit 203,for example.

[0138] In other words, as shown in FIG. 7, the PHS unit 203 comprisesthe antenna switch 252 which is connected with the antenna 251; thereception amplifier (AMP) 265 to which is supplied the output of theantenna switch 252; the synthesizer 257; the reception circuit 254 towhich is supplied each of the outputs of the reception amplifier 265 andthe synthesizer 257; the ADPCM codec circuit 260, the PIAFS framedisassemble/assemble circuit 262, and the control circuit 263, to whichthe output of the TDMA deframer circuit 259 is supplied, respectively;and the application unit (hereinafter referred to as application) 264which is connected with the control circuit 263. The PIAFS framedisassemble/assemble circuit 262 is connected with the control circuit263, and also, with the application 264. The synthesizer 257 is arrangedso that the output of the control circuit 263 is supplied to it. Also,the speaker and receiver set 261 is connected with the ADPCM codeccircuit 260.

[0139] Also, the PHS unit 203 comprises the TDMA framer circuit 258 towhich is supplied each of the outputs of the control circuit 263 and theADPCM codec circuit 260; the transmission circuit 255 to which issupplied each of the outputs of the synthesizer 257 and the TDMA framercircuit 258; and the transmission amplifier 253 to which is suppliedeach of the outputs of the control circuit 263 and the transmissioncircuit 255. The output of the transmission amplifier 253 is sent outfrom the antenna 251 by way of the antenna switch 252.

[0140] With the PHS unit 203 as described above, the operation isperformed to switch, at first, the antenna switch 252 so that thetransmission path that sends out data from the antenna 251 is switchedover to the reception path that receives data from the antenna 251, andvice versa.

[0141] The control circuit 263 makes the control of each of thefunctional blocks (each of the circuits), and at the same time, acceptsthe requests from the application 264, and also, notifies each status tothe application 264.

[0142] The application 264 is formed by the application of each of thefunctions that perform the corresponding service. For example, theapplication operates in response to the operation of the sub-CPU 1 ofthe sub-CPU unit 202, the CPU 29 of the main CPU unit 201, and each ofthe softwares (each of the programs to be described later). Then, to thePHS unit 203, the sub-CPU 1 gives each command and data related to theoperation of the PHS unit. The communications carried out by the PHSunit 203 are controlled by the CPU 29.

[0143] Now, when transmission is made, the antenna switch 252 is, atfirst, switched over to the reception path.

[0144] Then, in accordance the control of the control circuit 263, thePIAFS frame disassemble/assemble circuit 262 processes the assemblingprocess for the data provided by the application 264 for transmission onthe basis of the PHS data communication regulation (PIAFS standard).After that, the PIAFS frame disassemble/assemble circuit 262 suppliesthe transmission data thus assembled to the TDMA framer circuit 258.

[0145] At this juncture, the message information TX_MSG is also suppliedfrom the control circuit 263 to the TDMA framer circuit 258.

[0146] Also, the ADPCM codec circuit 260 digitizes the audio datainputted from the speaker and receiver set 261, and supplies it to theTDMA framer circuit 258.

[0147] Therefore, the TDMA framer circuit 258 assembles on thecommunication framer (TDMA frame) the message information TX_MSG fromthe control circuit 263 and the data TCH_TX from the PIAFS framedisassemble/assemble circuit 262 and the ADPCM codec circuit 260, andsupplies the assembled data to the transmission circuit 255.

[0148] Here, the control circuit 263 transmits to the synthesizer 257the standard signal of a certain frequency to designate a carrier. Inthis way, the synthesizer 257 designates the carrier of the transmissioncircuit 255.

[0149] With the carrier thus designated by the synthesizer 257, thetransmission circuit 255 modulates the data from the TDMA framer circuit258, and supplies them to the transmission amplifier 253.

[0150] The transmission amplifier 253 amplifies the data from thetransmission circuit 255 in accordance with the control (TX_POWER) ofthe control circuit 263, and transmits them from the antenna 251 throughthe antenna switch 252.

[0151] At the reception, on the other hand, the antenna switch 252switches over the current path to the reception path at first.

[0152] Then, the data are received from the antenna 251 and amplified bythe reception amplifier 265. After that, the data thus amplified aresupplied to the reception circuit 254.

[0153] At this juncture, the control circuit 263 designates a carrier bytransmitting the standard signal of a certain frequency. In this way,the synthesizer 257 designates the carrier for the reception circuit254.

[0154] With the carrier thus designated by the synthesizer 257, thereception circuit 254 demodulates the reception data from the receptionamplifier 265, and supplies them to the TDMA deframer circuit 259.

[0155] The TDMA deframer circuit 259 disassembles the reception data(data frame) from the reception circuit 254 into the message informationRX_MSG to the control circuit 263, and the information data oncommunication TCH_RX, such as audio and PIAFS data, and then, suppliesthe message information RX_MSG to the control circuit 263, and theinformation data on communication TCH_RX to the ADPCM codec circuit 260and to the PIAFS frame disassemble/assemble circuit 262, respectively.

[0156] The ADPCM codec circuit 260 converts the audio data contained inthe information data on communication TCH_RX from the TDMA deframercircuit 259 into the analogue data, and outputs them to the speaker andreceiver set 261 as voices.

[0157] In accordance with the control of the control circuit 263, thePIAFS frame disassemble/assemble circuit 262 performs the disassemblingprocess of the information data on communication TCH_RX from the TDMAdeframer circuit 259 on the basis of the PHS communication regulation(PIAFS standard). Then, the PIAFS frame disassemble/assemble circuit 262supplies the data obtained by such disassembling to the application 264.

[0158] The control circuit 263 supplies the message information RX_MSGfrom the TDMA deframer circuit 259 to the application 264.

[0159] The application 264 performs the respective processes for thedata from the PIAFS frame disassemble/assemble circuit 262 and thecontrol circuit 263.

[0160] (4) Main CPU Unit 201

[0161] As shown in FIG. 5, the main CPU unit 201 comprises the aforesaidCPU 29; the EDODRAM 30 which is connected with the CPU 29; the flash ROM31 and ROM 32; and the IrDALED 36 with which the IrDA module 35 and IrDAmodule 35 are connected.

[0162] Also, the main CPU unit 201 is provided with the crystaloscillators 46 and 47 installed for the CPU 29.

[0163] For the main CPU unit 201 thus arranged, the CPU 29 (the CPUchip) is at first provided with three serial ports (SerialPorts 0 to 2).

[0164] The signal line 38 of the serial port SerialPort 0 is used forcommunication with the camera unit 204. Therefore, the CPU 29 issuesinstructions to the camera regarding the exposure condition, the use ofstroboscope, the photographing modes and timing, and others through thissignal line 38.

[0165] The signal line 37 of the serial port SerialPort 1 performs theIrDA communication with the external host computer (not shown). Here,the IrDA module 35 converts the serial data provided through the signalline 37 into the data for use of IrDA, and then, performs the infraredcommunication of the data obtained by the IrDA module for use of theIrDA by means of the IrDALED 36 (driver/receiver).

[0166] The signal line 34 of the serial port SerialPort 2 is used forcommunication with the wireless communication unit (not shown). To thewireless communication unit, commands are issued from the sub-CPU 1 ofthe sub-CPU unit 202, while the communication data are provided by theCPU 29 through the signal line 34. Therefore, it becomes possible tocollect instructions and information to the wireless communication unitwithout interrupting the transmission while the wireless communicationis being made. This communication is usable to obtain the information ofthe field intensity, for example.

[0167] Also, the CPU 29 is provided with the parallel interface 19, andthe sub-CPU unit 202 and the main CPU unit 201 are connected by use ofthis parallel interface 19.

[0168] Further, the CPU 29 executes the image capturing; theinterpolation and thinning processes of image signals; display outputsto the black and white LCD 104 and the color LCD 107; communicationswith the camera microcomputer 211 of the camera unit 204, and with thesub-CPU 202, as well as with the aforesaid wireless communication unit;communications with the external host computer; the protocol processesusually used for the inter net, such as TCP/IP; and the user'sapplication such as electronic mails or WWW.

[0169] Therefore, the CPU 29 comprises the interface 39 and displayinterface 41 of the camera unit 204, besides, although not shown, itcomprises serial ports, memory interface, parallel interface, generalpurpose I/O (hereinafter referred to as GPIO), arithmetic unit, cachestorage, DMA controller, timer, and compression and expansion engines,among some others.

[0170] In this respect, the interface 39 of the camera unit 204 and thedisplay interface 41 will be described later in detail.

[0171] It is also made possible to call interruption with respect to theinterface of the camera unit 204, the display interface, the timer, andDMA controller, the GPIO, the serial interface, the parallel interface,and the compression and expansion engines when each of the respectiveoperations should be changed or some other event should take place.

[0172] For the DMA channel, it is arranged to be able to perform thedata transfer as soon as data are ready without any intervention of thearithmetic unit, because the interface of the camera unit 204, thedisplay interface, the serial interface, and the compression andexpansion engines are allocated to this channel.

[0173] The EDODRAM 30 is used as the working area of the OS and theapplication software. Here, the EDODRAM 30 is formed by two EDODRAMseach having 16 M (1×16) bit at 3.3 V.

[0174] Here, the EDODRAM 30 supports the self refresh mode, and it isarranged to be shiftable to the low power dissipation status by thecontrol of the memory controller (not shown) of the CPU 29.

[0175] The flash ROM 31 is the NOR type memory, for example, which isconnected in the same mode as the usual SRAM when serving as a hardwareinterface.

[0176] The flash ROM 31 is used for storing images obtained by thephotography performed in the camera unit 204, and for recording receivedelectronic mails, data obtained by the ftp communications, audio datafrom the speaker and receiver set 261 (microphone) of the PHS unit 203,and various data such as parameters.

[0177] Then, writing to the flash ROM 31 is made in accordance with theprotocol of the software program to be executed on the CPU 29.

[0178] The ROM 32 is formed by the 16M-bit mask ROM, for example, andstores the OS and the programs of the application software themselves.

[0179] This ROM 32 is selected when the power-supply is turned on forthe CPU 29 or after the release of resetting. Then, the bootstrap codeis selected.

[0180] The crystal oscillators 46 and 47 generate the frequency to beused in the CPU 29.

[0181] The crystal oscillator 46 generates the frequency to be used whenthe entire system is controlled and the NTSC is coded. On the otherhand, the oscillator 47 generates the frequency to be used when data areobtained from the camera unit 204 (for data input).

[0182] These crystal oscillators 46 and 47 are structured so as tosuspend its oscillations in the circumstance of the low powerconsumption.

[0183] The interface 39 of the camera unit 204 is used when the imagedata transferred from the camera unit 204 are stored on the flash ROM31.

[0184] Here, the image data thus transferred are the data in the formatof 4:2:2 of the image signals (CCDRaw data) obtained by the photographyusing the photographing device 213 after the image is processed in theimage processor 216 as to the color space conversion, imageinterpolation, automatic exposure adjustment, automatic white balancing,automatic focusing, and so on. As a result, there is a need for thegeneration of the sampling frequency which is two times the usual CCDRawdata.

[0185] Here, the CPU 29 provides the horizontally synchronized signal HDand vertically synchronized signal VD for the image processor 216 andthe timing generator 218 of the camera unit 204 through the signal line40. In this way, it becomes possible to store the image data on theflash ROM at the timing in synchronism with the camera unit 204.

[0186] The display interface 41 is used for providing the output NTSCsignals from the CPU 29 for the external connector 42 and the LCDcontroller 53 of the color LCD 107 as well.

[0187] Therefore, the LCD controller 45 supplies the NTSC signalsobtained from the display interface 41 to the color LCD 43 through thevoltage conversion device 44.

[0188] These have been the descriptions of the main CPU unit 210, thesub-CPU unit 220, the PHS unit 230, and the camera unit 240, which formthe principal structure of the digital camera 100.

[0189] Now, the specific description will be made of the operationalcontrol when the digital camera 100 is used for photographing.

[0190] (1) The Control of the Photographing Operation in the CAMERA Mode

[0191] On the ROM 32, a program is stored in advance in accordance withthe flowchart shown in FIG. 8, for example. When this program is read bythe CPU 29 for execution, the photographing operation is carried out bythe digital camera 100 as given below.

[0192] In other words, when the power-supply is turned on by operatingthe mode dial 101 of the digital camera 100 or the CAMERA mode isswitched on at first (step S501), charging begins to charge thecapacitor for use of stroboscopic emission (step S502). This is becausethe stroboscopic emission should be ready for immediate use when thestroboscopic photographing mode is further dialed in the CAMERA mode.

[0193] Then, the operation of the camera microcomputer 211 (the CCDmodule that includes the controller) is enabled (step S503) to controlthe photographing device 213 and the like in the camera unit 204.Continuously, then, the operation begins so as to make the color LCD 107functional as an electronic view finder (EVF) for the confirmation of anobject (not shown) to be photographed (step S504).

[0194] Now, when the photographing begins, the continuous processes fromthe image that has been taken in the camera unit 204 up to the displaythereof on the screen of the color LCD 107 are carried out in thefollowing steps:

[0195] At first, the optical information of the object that has beentaken in from the lens 108 is converted into the electric signal by useof the photographing device 213 (photoelectric conversion process) (stepS505).

[0196] The output signal of the photographing device 213 is theinterlace analogue signal. Then, in order to make the processing speedfaster, it is arranged to compress data to a size of 320×320 pixels bythe application of thinning process, not the data having the totalpixels of 1,280×960.

[0197] Subsequently, the signal obtained in the step S505 is transmittedto the image processor 216 for the execution of the image processdescribed above (step S506). In other words, the correction processes,such as the automatic white balancing, AE, and stroboscopic photography,are executed. The image process, such as conversion to the YCrCb (4:2:2)format, is also executed in this step.

[0198] Here, the signal obtained in the step S506 (that is, the signalconverted into the YCrCb format) is further processed by the applicationof a software in order to correct the deviation in the aspect ratioresulting from the difference in the output image signal on the colorLCD 107 (EVF) and the processing frequency (step S507).

[0199] Then, the signal processed in the step S506 and step S507 isconverted into the NTSC signal by use of the NTSC encoder (not shown)(step S508). The signal thus processed is supplied to the LCD controller45 of the color LCD 107 (step S509).

[0200] Consequently, the image of the object observed by the EVF isindicated on the screen of the color LCD 107 by the signal output of theLCD controller 45 (step S510).

[0201] Each of the processing steps S505 to step S510 as described aboveis executed as a continuous loop at a cycle of {fraction (1/30)} second.Thus, the objective image is always monitored on the screen of the colorLCD 107.

[0202] Now, during the monitoring period on the color LCD 107, if thephotographer operates any one of the keys, an interruption event takesplace following the detection signal thereof. Then, the process shiftsto the interruption process A.

[0203] (1-1) Interruption Process A

[0204] On the ROM 32, a program is stored in advance in accordance withthe flowchart shown in FIG. 9. When this program is read by the CPU 29for execution, the interruption process is enabled (the interruptionprocess by the key operation) for its execution as given below.

[0205] Here, in the stage where the key operation is made, either one ofthe two modes is internally designated. One of them is the normal mode,which is the mode as shown in FIG. 8 wherein the monitoring operation ofa photographed image is continuously performed since the power-supplyhas been turned on. The other one is the half depressed mode where theshutter button 102 is half depressed once to lock each of the camerasettings, and then, in such status, the monitoring operation of theimage takes place.

[0206] Here, now, these processes are divided into two, and thedescription will be made of the starting position of the processes bythe one to be carried out in the normal mode, and the other to becarried out beginning with the half depressed mode.

[0207] (1-1-1) The Interruption Process in the Normal Mode

[0208] At first, the key status is read (step S521) to detect which oneof the keys is operated.

[0209] Then, in accordance with the key status fetched in to the stepS521, the current setting values are locked (step S523) with respect tothe various camera settings in the image processor 216, such as theautomatic white balancing, AE, stroboscopic correction in case of astroboscope 109 photography, if it is determined that the shutter switch102 has been operated (step S522). Then, the operation of the color LCD107 (EVF) is suspended (step S537) in order to reduce the processingload on the CPU 29.

[0210] Subsequently, the capture signal is fetched in for the full imageof 1,280×960 pixels as the photographed image, although, as describedearlier, the monitoring image process has been made only for the signalhaving the pixel numbers of a compressed image size for the purpose ofspeeding up the required processes. Then, after given image processeshave been executed in the image processor 216, the data is stored in theEDODRAM 30 in the YCrCb format (step S538).

[0211] The data thus stored in the EDODRAM 30 in the step S538, theimage depression process is carried out (step S539) on the basis of theJPEG regulation. The compressed data are written on the flash ROM 31 asan image file (step S540).

[0212] Then, the color LCD 107 whose operation has been suspended isrestored (step S541), and the image file written on the flash ROM 31 isdisplayed on the screen of the color LCD 107 for a given period of time(step S542) so that the confirmation of the photographed image is madepossible. Thus, the current interruption process is completed (stepS543). The process returns to the loop process shown in FIG. 8 to resumethe monitoring process of the image.

[0213] On the other hand, if it is determined that the Play back key isoperated by the key status fetched in to the step S521 (step S524), theprocess of the Play back function will be executed as described later.

[0214] Also, if it is determined that the shutter button 102 has beenhalf depressed by the key status fetched in to the step S521 (stepS525), the inner state of setting is defined to be the half depressedmode (step S526). Then, as in the step S523 described above, each of thecamera settings in the image processor 216, such as the automatic whitebalancing, AE, stroboscopic correction in case of a stroboscopephotography, is locked at the current setting value, respectively (stepS527).

[0215] After that, the current interruption process is completed (stepS528). The process will return to the loop process as shown in FIG. 8.Then, the monitoring process of the image is resumed.

[0216] Also, if it is determined that the key operation has been made tochange the photographing conditions by the key status fetched in to thestep S521 (step S529), the inner state of each setting in the imageprocessor 216, such as the automatic white balancing, AE, stroboscopiccorrection in case of a stroboscope photography, is modified to be setagain at the designated conditions (step S530). Then, the currentinterruption process is completed (step S528). The process will returnto the loop process as shown in FIG. 8. Then, the monitoring process ofthe image is resumed.

[0217] Also, if it is determined that the OFF key (source-supply off) isoperated by the, key status fetched in to the step S421 (step S531), theoperation of the color LCD 107 is terminated (step S532). The operationof the CCD module is also terminated (step S533) one after another.Then, after the other photographing operations are terminated, thesource-supply process is turned off (step S534).

[0218] On the other hand, if it is not determined in the step S531 thatthe OFF key (source-supply off) is operated, it is interpreted that noeffective key operation has been made. The current interruption processis then terminated (step S528) without executing any processes. Theprocess will return to the loop process as shown in FIG. 8, and theimage monitoring process is resumed.

[0219] (1-1-2) The Interruption Process in the Half Depressed Mode

[0220] At first, the key status is read in order to detect which one ofthe keys is operated (step S535).

[0221] If it is determined that the shutter switch 102 is operated bythe key status fetched in to the step S521 (step S536), the processesbeginning with the step S537 described above are executed, while each ofthe camera settings in the image processor 216 which has been locked(step S527) by the previous detection of the half depressed key (stepS525) is still kept effective.

[0222] On the other hand, if it is determined that the half depressionof the shutter switch 102 has been released by the key status fetched into the step S521 (step S545), the inner status settings in the halfdepressed mode are released (step S546). Then, the current interruptionprocess is terminated (step S528). The process will return to the loopprocess as shown in FIG. 8, and the monitoring of the image is resumed.

[0223] Also, if it is not determined that the half depression of theshutter switch 102 has been released by the key status fetched in to thestep S521 (step S545), it is interpreted that no effective key operationhas been made. The current interruption process is then terminated (stepS528) without executing any processes. The process will again return tothe loop process as shown in FIG. 8, and the image monitoring process isresumed.

[0224] (1-2) The Process of the Play Back Function B

[0225] The process of the Play back function B is executed when it isdetermined in the key operation determination process (step S524) inFIG. 9 that the key is operated to function the Play back.

[0226] Here, the Play back function is to make it possible to effectuateaction upon an image immediately after having been photographed, such asthe provision of audio information or the like (the function of audioaddition), the transfer of image information by use of the electronicmail (the mail transfer function), the deletion of images (the imagedelete function), among some others, by means of simple key operationswithout changing modes.

[0227] Now, therefore, the ROM 32 is provided in advance with a storedprogram in accordance with the flowchart shown in FIG. 10. When thisprogram is read by the CPU 29 for execution, the processes of the Playback function will be made as given below.

[0228] At first, it is determined whether or not there is any image thathas been obtained by photographing immediately before (step S551).

[0229] The image taken immediately before means a photographed imagewhich has been kept effective since the photographing operation has beenexecuted by use of the shutter button 102 up to the moment the mode ischanged or any one of other functional operations is performed.

[0230] Then, if it is found as a result of the detection that there isno image taken immediately before, no process will be executed, and thecurrent interruption process is terminated (S540). The process willreturn again to the loop process as shown in FIG. 8. The imagemonitoring is resumed.

[0231] On the other hand, if there is any image that has been takenimmediately before, the correction process is executed, at first, by theapplication of software with respect to the aspect ratio resulting fromthe difference in processing frequency for such image taken immediatelybefore as has been written on the EDODRAM 30 in the same manner as theprocesses executed in the step S507 to the step S510 as shown in FIG. 8(step S552).

[0232] Then, the signal processed in the step S552 is converted into theNTSC signal (step S553) by use of the NTSC encoder (not shown). Thesignal thus converted is supplied to the LCD controller 45 of the colorLCD 107 (step S554).

[0233] Consequently, the object image is displayed on the screen of thecolor LCD 107 by means of the EVF (step S555) with the output signal ofthe LCD controller 45.

[0234] After that, the kind of the Play back functions which has beenselected by the photographer is distinguished (step S556). Then, theprocess is branched out to the corresponding one accordingly.

[0235] In other words, if the audio addition function is selected, theaudio addition process will be executed (step S557). If the mailtransfer function is selected, the mail transfer process will beexecuted (step S558). If the image deleting function is selected, thecorresponding process will be executed to delete the photographed image(step S559).

[0236] (2) VIEW Mode (Image Display Mode)

[0237] The View mode is to reproduce (display) the image that has beenobtained by photographing.

[0238] Here, therefore, a program is stored on the ROM 32 in accordancewith the flowchart shown in FIG. 11. When the program is read by the CPU29 for execution, the operation of the VIEW mode of the digital camera100 will be carried out as given below.

[0239] At first, the source-supply is turned on by the operation of themode dial 101 of the digital camera 100 or the VIEW mode is dialed to beswitched (step S571), the operation of the color LCD 107 begins (stepS572) so that the color LCD 107 operates as the electronic view finder(EVF) for the confirmation of an object when it is photographed.

[0240] Now, as shown in FIG. 9, the compressed image file, which hasbeen written on the flash ROM 31 by the writing process of thephotographed image (step S540) is read (step S573). Then, thedecompression process, that is, the process to convert the compresseddata on the basis of the JPEG standard into the original data (the datain the YCrCb format), is executed (step S574).

[0241] After that, the original data thus obtained by decompression inthe step S574 is written on the EDODRAM 3 (step S575).

[0242] Thereafter, in the same manner as the processes in the step S507to the step S510 shown in FIG. 8, the correction process and others willbe executed (step S576) by the application of software as to thedeviation of the aspect ratio resulting from the difference in theprocessing frequency for the original data (image data) written on theEDODRAM 30. Then, by use of the NTSC encoder (not shown), the data isconverted into the NTSC signal (step S577), and supplied to the LCDcontroller 45 of the color LCD 107 (step S578).

[0243] Therefore, on the color LCD 107, the selected image by thedesignation of the EVF is displayed on its screen by use of the outputsignal of the LCD controller 45 (step S579).

[0244] (3) The Operational Control of the Electronic Mail at the Time ofTransmission and Reception

[0245] A program is stored on the ROM 32 in accordance with theflowchart shown in FIG. 12 to FIG. 14, for example. When the program isread by the CPU 29 for execution, the transmitting and receivingoperation of the electronic mail will be carried out for the digitalcameral 100 as given below.

[0246] (3-1) The Link Establishment

[0247] Here, for example, it is assumed that the TCP/IP linkestablishment is made by the PPP (point to point protocol) using thetelephone line.

[0248] In other words, as shown in FIG. 12, the connecting process forthe telephone line begins, at first, by means of the AT command (stepS581).

[0249] Then, it is determined whether or not the connection of thetelephone line has been established (step S582), and if connected, theTCP/IP connection process begins by the PPP (step S583).

[0250] Subsequently, by the LCP (link control protocol), the linkestablishment process is executed for the data link layer (step S584).

[0251] Then, it is determined whether or not the user approval is needed(step S585). If needed, the protocol of the user approval will beexecuted (step S586).

[0252] If the user approval is not needed, the setting by the NCP(network control protocol) is confirmed (step S587). This confirmationshould also be made after the execution of the user approval protocolwhen the user approval is needed.

[0253] Then, the connection by the PPP is established (step S588), andalso, the connection by the LCP is established (step S589). After that,the current process is terminated.

[0254] (3-2) The Transmission of the Electronic Mail

[0255] If, for example, an electronic mail should be transmitted by theSMTP (simple mail transfer protocol), the SMTP client (hereinafter,simply referred to as a client) issues, at first, the request ofconnection to the SMTP server (hereinafter, simply referred to as aserver) for the transmission and reception of an electronic mail (stepS591).

[0256] When the server is connected by this request, the server returnsto the client his response code indicating “connection OK”.

[0257] When the client recognizes the reception of this response code(step S592), he declares to the server the commencement of use bynotifying the server of his domain name by means of the HELO command(step S593).

[0258] Then, the server returns to the client the response codeindicating “normal”, together with the domain name of the server whenthe server recognizes the domain name of the client.

[0259] When the client recognizes the reception of this response codeand the domain name of the server (step S594), he notifies the server ofthe From information by means of the MAIL command and declares thecommencement of electronic mail transmission (step S595) by designatingthe user name (address) at the source of transmission.

[0260] Then, the server returns to the client the response codeindicating “normal” when he recognizes that the user name (address) atthe source of transmission is correct, and that the reception of thismail is ready by the reception of the From information from the clientand the user name at the source of transmission.

[0261] When the client recognizes the reception of this response code(step S596), he designates the address of the mail for the server (stepS597) by, means of the RCPT command.

[0262] Here, if the mail should be sent to a plurality of parties, theplural mail addresses are designated in the step S597 accordingly.

[0263] Then, the server determines whether or not the mail addressdesignated by the client is acceptable, and returns to the client theresponse code indicating “normal” if he can handle the address thusdesignated. If he cannot handle it, he returns the code indicating thatthe mail will be transferred to the other SMTP server.

[0264] When the client recognizes the reception of the normal responsecode (step S598), he declares to the server the text transmission of hismail by means of the DATA command (step S599).

[0265] If the reception is ready, the server returns to the client theresponse code indicating “the admission of the mail transmission” (theresponse code 354) when he receives from the client the declaration ofthe text transmission of his mail.

[0266] When the client recognizes the reception of this response code(step S600), he transmits to the server the text of his mail (stepS601). Then, the client transmits the code indicated by <CR> <LF> <CR><LF>, and the like to declare the finish of his text transmission (stepS602). Here, in accordance with the present embodiment, it may bepossible, for the client to attach the image file, which is the file ofphotographed images, for example, or the file of received images to thetext of his mail.

[0267] Then, the server returns to the client the response codeindicating that he has completely complied with the client's requestnormally (the response code 250) when he receives the client'sdeclaration of the termination of his text transmission.

[0268] When the client recognizes the reception of this response code(step S603), he declares to the server the termination of histransmission of the SMTP electronic mail (step S604).

[0269] Then, the server returns to the client the response codeindicating “termination” when he receives the client's declaration ofthe termination.

[0270] When the client recognizes the reception of this response code(step S605), the TCP connection is cut off to terminate the currentprocess.

[0271] (3-3) The Reception of the Electronic Mail

[0272] When an electronic mail is received by the POP 3 (Post OfficeProtocol version 3), for example, the POP client (hereinafter, simplyreferred to as a client) issues, at first, his request to the POP server(hereinafter, simply referred to as a server) for connection to receivethe electronic mail as shown in FIG. 14 (step S611).

[0273] Then, the server returns to the client the response codeindicating “connection OK” together with the name of the server.

[0274] Recognizing the reception of this response code and the name ofthe server (step S612), the client transmits to the server the name ofthe user and pass word for the server's identification by means of theUSER command and the PASS command (step S613).

[0275] Then, when the server is able to confirm the user's name and password from the client, he returns to the client the response codeindicating “normal”.

[0276] Recognizing the reception of this response code (step S614), theclient requests the server the information of the mail box (step S615)by means of the STAT command (the command whereby to request theinformation of reception status of the mail box, such as numbers ofmail), and the LIST command (the command whereby to request the listinformation of mails currently kept in the mail box) as required (stepS615).

[0277] Then, the server transmits to the client the mail box informationto comply with his request.

[0278] On the basis of the information received from the server, theclient requests the server the transmission of the required mails (stepS616).

[0279] Then, the server transmits to the client the required mails (stepS617).

[0280] With the reception of mails from the server, he examines whetheror not he has requested the server all the mails he needs (step S618).If it is found that there are still some more mails to be requested,then he returns to the process in the step S615, and repeats theprocesses thereafter.

[0281] If he has found that all the requested mails are received fromthe server as needed, he requests the server the execution of updatingthe mail box, and then, declares terminating his reception of theelectronic mail by the POP 3 (step S619).

[0282] Then, the server returns to the client the response codeindicating “termination” in accordance with the client's declaration ofthe termination.

[0283] When the client recognizes the reception of this response code(step S620), the connection of the POP 3 is cut off, and the currentprocess is terminated.

[0284]FIG. 15 is the conceptual block diagram which shows the controlflow for the digital camera 100 structured to perform various operationswith the various function provided as described above, for example.

[0285] In other words, the digital camera 100 comprises a communicationunit 301; the reception amount arithmetic unit 302 and the data storage303 to which the output of the communication unit 301 is supplied,respectively; the memory 304 to which is supplied the output from thedata storage 303; an image input unit 305; the image compression unit306 to which is supplied the output from the image input unit 305; andthe image storage unit 307 to which is supplied the output from theimage compression unit 306. It is also arranged that the output of theimage storage unit 307 is supplied to the memory 304.

[0286] The digital camera 100 further comprises the memory remainderarithmetic unit 309 to which is supplied the output from the memory 304;an input unit 310; the photographing mode setting unit 311 to which issupplied the output from the input unit 310; and the photographed imageamount control unit 308 to which is supplied each of the outputs fromthe memory remainders arithmetic unit 309 and the photographing modesetting unit 311. It is also arranged that the output of thephotographed image amount control unit 308 is supplied to the imagecompression unit 306.

[0287] Now, the communication unit 301 is the unit that corresponds tothe PHS unit 203.

[0288] The reception amount arithmetic unit 302 is implemented by theapplication of software to be executed by the CPU 29 of the main CPUunit 201. The reception amount arithmetic unit 302 works out the dataamount (the estimated amount of reception data) of the data expected tobe received by the communication unit 301 using the communicationprotocol.

[0289] The data storage 303 stores the data received by thecommunication unit 301 on the memory 304 by use of the filing system.

[0290] The memory 304 corresponds to the flash ROM 32 (non-volatilememory) of the main CPU 201.

[0291] The image input unit 305 corresponds to the entire body of thecamera unit 204 which is structured as shown in FIG. 6.

[0292] The image compression unit 306 is incorporated in the CPU 29,which is able to adjust the image size after compression by changing thedesignations as to the quantization table.

[0293] The image storage unit 307 stores the image data compressed bythe image compression unit 306 on the memory 304 by the operation of theCPU 29.

[0294] The photographed image amount control unit 308 is implemented bythe application of software used by the CPU 29.

[0295] More specifically, the compression control is carried out bychanging the parameters of the quantization table or the like in theimage compression unit 306. In other words, if it is determined that theremainders of the memory 304 are small by the indication of the memoryremainders arithmetic unit 309, which will be described later, the imagecompression unit 306 is informed accordingly so that the imagecompression unit 306 may be able to change the compression ratios.

[0296] The memory remainders arithmetic unit 309 is implemented by theapplication of software used by the CPU 29, and when the remainders ofthe memory 304 are calculated, this unit uses the file system tablearranged on the memory 304.

[0297] The input unit 310 corresponds to the mode dial 101. In otherwords, this unit is used when the photographer designates thephotographing mode or the like.

[0298] The photographing mode setting unit 311 sets the photographingmode by notifying the current status of the mode dial 101 (input unit310) to the CPU 29 by use of the sub-CPU 1 of the sub-CPU unit 202.

[0299] Here, the Table 1 shows one example of the photographing mode inwhich the modification is given to the aforesaid image compression unit306 by means 308 for controlling the photographed image amount, and thetypical image sizes, as well as the numbers of the quantization tableused at that time. TABLE 1 PHOTOGRAPHING SUPER MODE FINE FINE NORMALECONMY Typical 200 KB 100 KB 50 KB 25 KB Size QUANTIZING 1 2 3 4 TABLE

[0300] Here, it is assumed that the photographing mode is classifiedinto four stages: superfine mode, fine mode, normal mode, and economymode, and that the image size after compression is classified into fourstages: 400 KB, 200 KB, 100 KB, and 50 KB.

[0301] Now, hereunder, the description will be made of the processesexecuted by the application of software for controlling the photographedimage amount.

[0302] On the ROM 32 of the main CPU unit 201, a program is stored inadvance in accordance with the flowchart shown in FIG. 16, for example.When this program is read by the CPU 29 for execution, the amount of thephotographed image is controlled for the digital camera 100 as givenbelow.

[0303] At first, the communication unit 301 (PHS unit 203) determineswhether or not the current status is the reception called (step S631),and also, whether or not the image input unit 305 (cameral unit 204) isin the photographing status (step S632).

[0304] As a result of this determination, if the status is the receptioncalled in the photographing mode, the following steps will be executed.If not, the current process will be terminated.

[0305] Here, the determination of whether or not the status is in thephotographing mode is, made by the detection of the current status ofthe shutter button 102: whether it has been half depressed or totallydepressed or by the detection of the CAMERA mode by means of the modedial 101.

[0306] Then, if the reception call is ready in the photographing status,the photographed image amount control unit 308 obtains the value A (stepS633) which is the value obtainable by subtracting the estimated amountof reception data calculated by the reception amount arithmetic unit 302from the remainders of the memory 304 calculated by the memoryremainders arithmetic unit 309.

[0307] Here, the estimated amount of reception data is worked out on thebasis of the estimated amount of data on the received Email, forexample. In other words, by use of the POP 3 described above as thecommunication protocol, the calculation is made by means of the POP 3LIST command and STAT command in the “various information requests tothe server” in the step S615 of the program shown in FIG. 14.

[0308] Now, the photographed image amount control unit 308 obtains fromthe aforesaid Table 1 the typical image size after compressioncorresponding to the current photographing mode set by the photographingmode setting unit 311. The image size thus obtained is subtracted fromthe value A that has been obtained in the step S633. After that, it isdetermined whether or not the resultant value exceeds a specific value(step S634).

[0309] Here, the reason why the value of the specific amount is used asoffset is that the compression of the JPEG type or the like makes itdifficult to estimate the image size after compression in advance, butto estimate only the typical image size after compression. Therefore,with the value of a specific amount which is set large enough, itbecomes possible to secure a specific number of photographed images evenafter the termination of communication.

[0310] If the value obtained by subtraction should exceed the value ofthe specific amount as the result of the determination in the step S634,it means to indicate that there is still a room for the remainders ofthe memory 304. Therefore, the reception process, the photographingprocess, the compression process, and the recording process will beexecuted continuously (step S638). Then, the current process isterminated.

[0311] If the value obtained by subtraction does not exceed the value ofthe specific amount as the result of the determination in the step S634,it is determined by the photograph image amount control unit 308 whetheror not there is any photographing mode applicable at a highercompression ratio by use of the aforesaid Table 1 in order to heightenthe compression ratio of the image compression unit 306 (step S635).

[0312] If there is no photographing mode found that may serve thepurpose as the result of the determination in the step S635, thereception operation is suspended (step S637), and the current process isterminated.

[0313] Here, as to the photographing operation, it is assumed that thephotographing operation is started after the remainders of the memory304 have been detected and confirmed. Therefore, it is possible tocontinue the photographing operation even if there is no suitablephotographing mode found applicable as the result of the determinationin the step S635.

[0314] If the corresponding photographing mode has been found as theresult of the determination in the step S635, the photographed imageamount control unit 308 heightens the compression ratio of the imagecompression unit 306 (step S636) by directing the image compression unit306 to the quantization table applicable to the photographing mode thatmay be obtained from the aforesaid Table 1.

[0315] Subsequently, the process returns to the step S634, and repeatsthe processing steps thereafter.

[0316] (Second Embodiment)

[0317] The structure of the digital camera of the present embodiment isthe same as that of the digital camera 100 in the accordance with thefirst embodiment described above. However, the control of the entirebody is different.

[0318] In other words, as shown in FIG. 15, the communicating operationof the compunction unit 301 and the photographing operation of the imageinput unit 305 are overlapped. Therefore, if the remainders of thememory 304 become insufficient, the amount of the reception data fromthe communicating party is controlled (restricted) by use of thecommunication protocol.

[0319] Consequently, the structure (the conceptual structure shown inthe block diagram) of the digital camera 100 shown in FIG. 15 ismodified to be the one shown in FIG. 17, for example.

[0320] As shown in FIG. 17, the reception amount control unit 321 isarranged in place of the photographed image amount control unit 308shown in FIG. 15.

[0321] The reception amount control unit 321 is implemented by theapplication of software of the CPU 29 to receive each of the outputssupplied from the reception amount arithmetic unit 302 and the memoryremainders arithmetic unit 309, and to output its processed data to thecommunication unit 301.

[0322] Also, the reception amount control unit 321 receives theinformation of the remainders of the memory 304 from the memoryremainders arithmetic unit 309, and if it is determined that the amountof the reception data is large, this unit notifies the communicationunit 301 accordingly so as to restrict the amount of reception data tobe received by the communication unit 301. More specifically, using thecommunication protocol this unit notifies the communicating party of itsdenial of the reception of data, partly or otherwise, through thecommunication unit 301.

[0323] Now, hereunder, the description will be made of the processesexecuted by the application of software to control (restrict) the amountof reception data.

[0324] Here, in this respect, the specific description will be made ofthe aspects which differ from those of the first embodiment.

[0325] On the ROM 32 of the main CPU unit 201, a program is stored inadvance in accordance with the flowchart shown in FIG. 18, for example.When this program is read by the CPU 29 for execution, the control(restriction) of the amount of reception data is performed for thedigital camera 100 as given below.

[0326] At first, in the same manner as in step S631 to step S634 shownin FIG. 16, it is determined whether or not the current status is thereception called or whether or not the current status is thephotographing (step S641 and step S642). If it is found that both thereception called and the photographing are ready, the following stepswill be executed for processing. If not, the current process isterminated.

[0327] In the reception called status, and also, in the photographingstatus, the reception amount control unit 321 obtains the value A whichis arrived at by subtracting the estimated amount of reception datacalculated by the reception amount arithmetic unit 302 from the amountof the memory remainders calculated by the memory remainders arithmeticunit 309 (step S643).

[0328] Then, the reception amount control unit 321 obtains from theaforesaid Table 1 the typical image size after compression correspondingto the current photographing mode set by the photographing mode settingunit 311. The image size thus obtained is subtracted from the value Aobtained in the step S643 to determine whether or not the resultantvalue exceeds the value of a specific amount (step S644).

[0329] If it is found that the subtracted value exceeds the value of thespecific amount as the result of determination in the step S644, thisindicates that there is still room for the remainders of the memory 304.Therefore, the reception process, the photographing process, thecompression process, and the recording process are continuously executed(step S648). Then, the current process will be terminated.

[0330] Here, if it is not found that the subtracted value exceeds thevalue of the specific amount as the result of determination in the stepS644, the reception amount control unit 321 inquires to thecommunicating party whether or not the transmission is still possiblewith a higher compression ratio through the communication unit 301 (stepS645).

[0331] If it is found in the step S645 that the transmission with ahigher compression ratio is impossible on the communicating party side,the reception operation is suspended (step S647), and then, the currentprocess will be terminated.

[0332] As described above, it is determined, at first, whether or notthe current status is the reception called or photographing (step S641and step S642). If affirmative, the processes in the step S643 and onare executed. If negative, the processes will be executed in the stepS702 and on as described later.

[0333] In the reception called status, and also, in the photographingstatus, the reception amount control unit 321 obtains the value A whichis arrived at by subtracting the estimated amount of reception datacalculated by the reception amount arithmetic unit 302 from the amountof the memory remainders calculated by the memory remainders arithmeticunit 309 (step S643).

[0334] Here, the estimated amount of the reception data is calculated bymeans of the required commands whereby to request various informationfrom the server. For example, the POP 3 LIST command and STAT commandare used as described in the paragraphs of “(3-3) Electronic MailReception”.

[0335] Then, the reception amount control unit 321 obtains from theaforesaid Table 1 the typical image size after compression correspondingto the current photographing mode set by the photographing mode settingunit 311. The image size thus obtained is subtracted from the value Aobtained in the step S643 to determine whether or not the resultantvalue exceeds the value of a specific amount (step S644).

[0336] Here, the reason why the “value of a specific amount” is used asoffset is that the compression of the JPEG type or the like makes itdifficult to estimate the image size after compression in advance, butto estimate only the typical image size after compression.

[0337] In this respect, if only the value of a specific amount should beset large enough, it becomes possible to secure a specific number ofphotographed images even after the termination of communication.

[0338] If the value obtained by subtraction should exceed the value ofthe specific amount as the result of the determination in the step S644,it means to indicate that there is still a room for the remainders ofthe memory 304. Therefore, the reception process, the photographingprocess, the compression process, and the recording process will beexecuted continuously (step S648). Then, the process proceeds to stepS702 shown in FIG. 19, which will be described later.

[0339] On the other hand, if it is not found as the result of thedetermination in the step S644 that the subtracted value exceeds thevalue of the specific amount, this means to indicate that it isimpossible to take a margin for the size of a specific image. Thus, thereception amount control unit 321 inquires to the communicating partywhether or not the transmission is still possible with a highercompression ratio (step S645).

[0340] If it is found in the step S645 that the transmission with ahigher compression ratio is impossible on the communicating party side,the reception operation is suspended (step S647).

[0341] Then, the process will proceed to step S702, which will bedescribed later.

[0342] Here, the photographing operation will be continued for thereason described above.

[0343] If it is determined in the step S645 that the transmission with ahigher compression is possible on the communicating party side, thecontrol is made to change the compression and expansion type by thecommunication unit 301 (the reception side) and by the communicatingparty side (transmission side) as well. At this juncture, theretransmission flag (inner flag) is set in the communication unit 301(step S646).

[0344] After that, the process will return to the step S644, and repeatthe processing steps thereafter.

[0345] (Third Embodiment)

[0346] In the step S702, the communication unit 301 examines if theretransmission flat is set or not.

[0347] As a result of this examination, if the retransmission flat isnot set, the communication unit 301 issues to the communicating partythe request of the original data retransmission. In this case, therequest of the retransmission of the original data is made afterpromoting the user to increase the remainders of the memory or after theremainders of the memory have been increased, for example. In this way,it is possible to prevent the shortage of memory remainders whenreceiving the original data for the normal execution of the originaldata reception (step S703).

[0348] After that, the retransmission flag is reset to terminate thecurrent process.

[0349] On the other hand, if the retransmission flag is not set in thestep S702, the current process will be terminated as it is.

[0350] (Fourth Embodiment)

[0351] For the second embodiment described above, it is arranged tocontrol (restrict) the amount of the reception data by changing thecompression and expansion type (see steps S645 and S646 in FIG. 18). Inaccordance with the present embodiment, only a part of the data(original data) that should be transmitted totally is received, andthen, the remaining part will be received after a photographing iscompleted. In this manner, the amount of the reception data will becontrolled (restricted).

[0352] Therefore, as the program executed by the CPU 29, a programprepared in accordance with the flowchart shown in FIG. 20 is used, forexample, in place of the program shown in FIG. 18. The control is thenmade in accordance with the present embodiment.

[0353] Here, the same reference marks as those appearing in theflowchart shown in FIG. 18 are applied to the same processing steps ofthe flowchart shown in FIG. 20, and the detailed description will beomitted. In this respect, the specific description will be made only ofthe structure which differs from that of the second embodiment.

[0354] At first, it is determined whether or not the current status isthe reception called or whether or not the current status is thephotographing (step S641 and step S642). As a result thereof, if it isfound that both the reception called and photographing status are ready,the next processing step S643 and on will be executed. If not, theprocessing steps will be executed beginning with the step S712 whichwill be described later.

[0355] With the status being the reception called and the photographing,the reception amount control unit 321 obtains the value A (step S643) bysubtracting the estimated amount of reception data calculated by thereception data arithmetic unit 302 form the amount of memory remainderscalculated by the memory remainders arithmetic unit 309 (step S643).

[0356] Then, the reception amount control unit 321 subtracts the typicalimage size after compression corresponding to the current photographingmode set by the photographing mode setting unit 311 from the value Aobtained in the step S643, and determines whether or not the resultthereof exceeds the value of a specific amount (step S644).

[0357] As a result of the determination in the step S644, if thesubtracted value exceeds the value of the specific amount, this means toindicate that there is still a room for the remainders of the memory304. Therefore, the reception process, the photographing process, thecompression process, and recording process will be continued (stepS648).

[0358] Then, the process will proceed to the step S712 which will bedescribed later.

[0359] On the other hand, if the subtracted value does not exceed thevalue of the specific amount as the result of the determination in thestep S644, this means to indicate that no margin is obtainable for thespecific size of an image. Therefore, the reception amount control unit321 controls the communication unit 301 so as to receive only a part ofall the data which are expected to be sent from the communicating party.For example, if it is the case of an electronic mail, only the“headings” are requested for reception. Also, in the communication unit301, the retransmission flag (inner flag) is set (step S711).

[0360] If the structure is made in this manner so that only a part ofthe original data is received from the communicating party side, somemore room is created in the memory remainders. Thus, the aforesaid stepS648 is made executable. As a result, the reception process, thephotographing process, the compression process, and the recordingprocess will be executed continuously (step S648).

[0361] After that, the process will proceed to step S712.

[0362] In the step S712, the communication unit 301 examines if theretransmission flag has been set.

[0363] It is found as the result of this examination that theretransmission flag has been set, the communication unit 301 issues tothe communicating party the request of retransmission of the remainingdata. In this case, such request of retransmission is issued afterhaving prompted the user to increase the memory remainders or after theremainders of the memory have been increased. Then, it becomes possibleto prevent the incapability of securing the remainders of the memorylarge enough to receive the original data or the occurrence of someother related problems. In this way, the original data can be receivednormally at all times (step S713). After that, the retransmission flagis reset, and the current process will be terminated.

[0364] On the other hand, if it is not found that the retransmissionflag is set, the current process will be terminated as it is.

[0365] (Fifth Embodiment)

[0366] In the third embodiment described above, the arrangement is madeso that if it is determined that the transmission is possible at ahigher compression ratio on the communicating party side (step S645),the data is transmitted with the modified compression ratio against theamount in which the data should be sent originally (step S701), and,therefore, when the connection is made again after the completion of thecurrent photographing, the request of retransmission of the data isissued (step S703) with respect to the data which should have been sentoriginally before (see FIG. 19).

[0367] In accordance with the present embodiment, when theretransmission request is issued in such a case described above, theimage data that has been photographed is transmitted to thecommunicating party, and then, the retransmission request is issued asshown in FIG. 21 (step S731)

[0368] In this way, with the transmission of the photographed data(photographed image data obtained by photographing) to the communicatingparty, the image data that has been in the corresponding unit can bedeleted. This in return makes it possible to increase the memoryremainders to that extent. Then, it becomes possible to prevent theincapability of securing the memory remainders large enough to receivethe original data from the communicating party or occurrence some otherrelated problems.

[0369] (Sixth Embodiment)

[0370] The digital camera of the present embodiment is structured in thesame manner as the digital camera 100 described in the secondembodiment. However, the control of the entire body thereof isdifferent.

[0371] In other words, when the reception is made as to the audio,image, and other streaming data which make the estimate of receptiondata amount difficult, it is arranged to issue the denial ofcommunication.

[0372] Now, hereunder, the description will be made of the applicationof software to be used for the reception of streaming data.

[0373] In this respect, only what differs from the second embodimentwill be described specifically.

[0374] On the ROM 32 of the main CPU unit 201, a program is stored inadvance in accordance with the flowchart shown in FIG. 22, for example.When this program is read by the CPU 29 for execution, the control ismade for the digital camera 100 as to the reception of streaming data asgiven below.

[0375] At first, in the same manner as in the step S641 to step S643shown in FIG. 18, it is determined whether or not the status is thereception called or whether or not the status is the photographing (stepS651 and step S652). As the result of this determination, if the statusis found to be the reception called and the photographing as well, thefollowing processing steps will be executed. If not the current processwill be terminated.

[0376] Then, in the case of the reception called and photographingstatuses, the reception amount control unit 321 obtains the value A bysubtracting the estimated amount of reception data calculated by thereception amount arithmetic unit 302 from the remainders of memory 304calculated by the memory remainders arithmetic unit 309 (step S653).

[0377] Now, the reception amount control unit 321 determines whether ornot the estimated amount of reception data calculated by the receptionamount arithmetic unit 302 is of the streaming data (step S654).

[0378] As the result of the determination in the step S654, if it isfound that the data is the streaming one, that is, if the data expectedto be received is such as recorded telephone conversations, thereception operation is suspended (step S657). Then, the current processwill be terminated.

[0379] This is because if the data is the streaming one, it is difficultto estimate the data amount or even if the estimate is possible, thefunction whereby to restrict the amount of the reception data asdescribed above may result in the structure which becomes simply awkwardfor the user to use eventually.

[0380] As the result of the determination in the step S654, if it is notfound that the data is not the streaming one, the reception amountcontrol unit 321 obtains the typical image size after compression fromthe aforesaid Table 1 corresponding to the current photographing modeset by the photographing mode setting unit 311 as shown in FIG. 18.Then, the image size thus obtained is subtracted from the value Aobtained in the step S643 to determine whether or not the resultantvalue exceeds the value of a specific amount (step S655).

[0381] If it is found that the subtracted value exceed the value of thespecific amount as the result of the determination in the step S655,this means to indicate that there is still a room for the remainders ofmemory 304. Thus, the reception process, the photographing process, thecompression process, and the recording process will be performedcontinuously (step S658). After that, the current process will beterminated.

[0382] If it is not found as the result of the determination in the stepS655 that the subtracted value exceeds the value of the specific amount,the reception operation is suspended (step S657). Then, the currentprocess will be terminated.

[0383] In this respect, it is of course possible to achieve theobjectives of the present invention by supplying to a system or to anapparatus, a storage medium on which the codes of application programsare recorded to implement the host and the terminals in accordance witheach of the embodiments described above so that the computer (or CPU orMPU) of such system or apparatus is arranged to be able to read suchstored programming codes on the storage medium for execution.

[0384] In this case, the programming codes themselves thus read from thestorage medium implement each of the functions of the respectiveembodiments. Therefore, it is to be understood that the storage mediumon which the aforesaid programming codes constitutes the presentinvention.

[0385] As the storage medium that may be able to supply the programmingcodes, there are ROM, floppy disc, hard disc, optical disc, magnet-opticdisc, CD-ROM, CD-R, magnetic tape, non-volatile memory card, and someother that can be used.

[0386] Also, it is to be understood that the present invention includesthe case as a matter of course where not only the functions of therespective embodiments described above can be implemented by theexecution of the programming codes read out by the computer, but also,the functions of the respective embodiments can be implemented by theprocesses executed by the OS or others operating in the computer whichperform the actual processes partly or totally in accordance with theinstructions from such programming codes.

[0387] Moreover, it is to be understood that the present inventionincludes the case as a matter of course where the programming codes areread from the storage medium and written on the memory of an extendedfunction board inserted into the computer or on the memory of theextended functional unit connected with the computer, and then, the CPUor the like provided for such extended function board or the extendedfunctional unit performs the actual processes partly or totally inaccordance with the instructions from the aforesaid programming codes,hence implementing the functions of the respective embodiments describedabove by means of such processes.

[0388] Also, as to the intervention operation of intervention means ofthe present invention (or the control operation of control means), thepresent invention is not necessarily limited to those described in therespective embodiments. For example, it may be possible to save theimage data simply on the buffer memory which is arranged to delay theimage input of the digital cameral or the like temporarily.

[0389] Also, as to the changes of the reception data in accordance withthe present invention, it may be possible to structure the arrangementso that the reception data is again compressed by the application of thedata compression algorithm (ZIP method or the like used for a personalcomputer) for example, not necessarily limited to those described in therespective embodiments.

[0390] In accordance with the present invention described above, itbecomes possible to overcome the disadantages or the like that thecollision of memory resources may take place when a digital camera and acommunication device are integrally formed for use with the arrangementto control the functions such as the automatic changes of compressionratio and the automatic changes of the sizes of reception data.

[0391] Consequently, it is possible to satisfy the communication havinga high immediacy, and the photographing having a high immediacy as wellat the same time. Furthermore, it becomes possible to provide a smallerapparatus or a smaller system having a higher operativity.

[0392] Also, on the photographing site, there is no possibility that thephotographer misses his shutter change. At the same time, he is able toperform his photographing quickly and to make a highly reliablecommunicate with his party or parties.

[0393] Moreover, since such controls as have been described above areimplemented by controlling the apparatus, the CPUs, memories, andothers, the structure can be formed simply so as to perform the controlswith the transmission device having the usual structure, the digitalcamera provided with an interface for transmission use, or the like.

[0394] Also, when the data transmission is performed on the transmissionside with the compression ratio which has been increased, it is possibleto obtain the data that should have been sent originally if it isstructured that the retransmission request may be issued after thecompletion of photographing.

[0395] In this case, the photographed image data (the photographed imageobtained and stored in an apparatus or a system) is at first transmittedto the transmission side, and then, such controls as have been describedabove may be performed.

[0396] In this way, the remainders of memory is increased so that thedata are received reliably from the transmission side.

[0397] With these features and advantages, the present invention shouldbe significantly useful at present and in future, because the imageinput is possible with a high immediacy by the combination ofcommunication, photographing, and some others, and at the same time, theapparatus is made smaller at low power dissipation and at lower costs ofmanufacture.

[0398] Now, various inventions have been shown in accordance with theembodiments described above. Here, besides the embodiments referred toin the paragraphs of the Summary of the Invention, there are still moreembodiments as given below.

[0399] Item 6:

[0400] For example, in accordance with the other embodiments, a methodof the present invention for processing images comprises the steps ofperforming the reception of data through the net work; inputting imagedata obtainable in accordance with the designated input mode; managingstep of managing the storage of the data received in the receiving stepand the image data inputted in the input step to the memory; and thestep of intervening between the operations of the reception step and theinput step in accordance with the storage management.

[0401] In this way, the data reception operation and the image inputoperation are controlled in accordance with the current status of memorystorage. Therefore, it becomes possible to deal with any suddenreception or the like during the storing operation of the image data onthe memory, hence making the compatibility possible with respect to theimmediacy of the image input, and the communication as well.

[0402] Item 7:

[0403] Also, the reception step further comprises the step of receivingdata through wireless net work.

[0404] In this manner, this method is arranged to be able to deal withcommunications on the wireless net work.

[0405] Item 8:

[0406] Also, the intervening step controls the input mode in the inputstep in accordance with the storage management.

[0407] In this manner, the method is arranged to be able to control thestoring operation of the image data on the memory by changing thecurrent input modes depending on the condition of the memory storage.

[0408] Item 9:

[0409] Now, the aforesaid input step further comprises an imageinreversible compression step, and the intervening means controls thecompression ratio in the compression step.

[0410] In this manner, the method is arranged to control the amount ofimage data to be stored on the memory by changing the compression ratiosdepending on the current status of the memory storage.

[0411] Item 10:

[0412] Furthermore, the managing means manages the remaining amount ofthe memory.

[0413] Hence, the method is arranged to control the data receptionoperation and the image input operation in accordance with the remainingcapacity of the memory storage.

[0414] Item 11:

[0415] Here, there are still other embodiments as given below.

[0416] An image input apparatus, which is provided with thecommunicating function, and storing on storage means an input imageobtainable in accordance with the reception data provided by thecommunicating function and inputted in the photographing mode designatedin advance, comprises image compression means for storing the storagemeans the input image at the compression ratio corresponding to thephotographing means; reception amount generating means for obtaining thecapacity required for the data reception by the communicating function;remainders generating means for obtaining the memory remainders for thestorage means; and control means for controlling the compression ratiosof the image compression means in accordance with the capacity obtainedby the reception amount generating means, and the memory remaindersobtained by the remainder generating means.

[0417] In this way, this apparatus is arranged to be able to heightenthe compression ratio of the image compression means by changing thecurrent photographing modes if, for example, the added value of therequired capacity (estimated reception size) for the data reception andthe data size of the input images predetermined by the currentphotographing mode (photographing quality mode) should be larger thanthe memory remainders. Therefore, it is possible to deal with any suddenreception during photographing, thus implementing the compatibility ofimmediacy between the photographing and communication.

[0418] Item 12:

[0419] Also, an image input apparatus comprises input means forinputting the photographing mode; image input means for inputting animage obtained by the photographing mode inputted by the input means;image compression means for compressing the input image inputted by theimage input means; communicating means for receiving arbitrary data;storage means for storing the input image compressed by the imagecompression means and the data received by the communicating means;remainder generating means for managing memory remainders of the storagemeans; and control means for controlling the compression ratios of theimage compression means in accordance with the capacity obtained by thereception amount generating means, and the memory remainders obtained bythe remainder generating means.

[0420] In this way, this apparatus is arranged to be able to compare theadded value of the required capacity (estimated reception size) for thedata reception and the data size of the input images predetermined bythe current photographing mode (photographing quality mode) with thememory remainders currently available, and then, if it is found by theresult of this comparison that such added value is larger than thememory remainders, the photographing mode is automatically changed so asto heighten the compression ratio to deal with any sudden receptionduring photographing. As a result, it becomes possible to implementconveniently the compatibility of immediacy between the photographingand communication.

[0421] Item 13:

[0422] An image input apparatus, which is provided with thecommunicating function, and storing on storage means an input imageobtainable in accordance with the reception data provided by thecommunicating function and inputted in the photographing mode designatedin advance, comprises reception amount generating means for obtainingthe required capacity for receiving data by the communicating function;remainders generating means for obtaining the memory remainders for thestorage means; and control means for controlling the receiving operationof the communicating function in accordance with the capacity obtainedby the reception amount generating means, and the memory remaindersobtained by the remainder generating means.

[0423] In this way, it becomes possible to receive only a part of theestimated reception data in advance or heighten the compression ratio ofthe reception data in order to make the size of the reception datasmaller if, for example, the added value of the required capacity(estimated reception size) for the data reception and the data size ofthe input images predetermined by the current photographing mode(photographing quality mode) should be larger than the memoryremainders. Therefore, it is possible to deal with any sudden receptionduring photographing, thus implementing the compatibility of immediacybetween the photographing and communication.

[0424] Item 14:

[0425] An image input apparatus comprises input means for inputting thephotographing mode; image input means for inputting an image obtained bythe photographing mode inputted by the input means; image compressionmeans for compressing the input image inputted by the image input means;communicating means for receiving arbitrary data; storage means forstoring the input image compressed by the image compression means andthe data received by the communicating means; remainder generating meansfor managing memory remainders of the storage means; reception amountgenerating means for obtaining the required capacity for receiving databy the communicating function; and control means for controlling theamount of reception data of the communicating means in accordance withthe memory remainders obtained by the remainder generating means, andthe capacity obtained by the reception amount generating means.

[0426] In this way, this apparatus is arranged to be able to compare theadded value of the required capacity (estimated reception size) for thedata reception and the data size of the input images predetermined bythe current photographing mode (photographing quality mode) with thememory remainders currently available, and then, if it is found by theresult of this comparison that such added value is larger than thememory remainders, the apparatus deals with any sudden reception duringthe photographing. More specifically, the apparatus performs the controlso as to receive only a part of the estimated reception data or toheighten the compression ratio thereof, among some other controls. As aresult, it becomes possible to implement conveniently the compatibilityof immediacy between the photographing and communication.

[0427] Item 15:

[0428] The aforesaid control means described in the item 13 or item 14restricts the reception data if the added value of the capacity obtainedby the reception amount generating means and the estimated size of theinput image defined in advance by the photographing mode is larger thanthe memory remainders of the storage means.

[0429] Here, in this case, the amount of the reception data isrestricted by the denial of the communication during the photographingor by some other means so as to enable the photographer to materializehis intention satisfactorily.

[0430] Item 16:

[0431] The aforesaid control means described in the item 13 or item 14restricts the amount of the reception data if the added value of thecapacity obtained by the reception amount generating means and theestimated size of the input image defined in advance by thephotographing mode is larger than the memory remainders of the storagemeans, and after that, the retransmission request of data is issued tothe transmission side.

[0432] Item 17:

[0433] The aforesaid control means described in the item 13 or item 14enables the transmission side to transmit the data having highercompression ratio if the added value of the capacity obtained by thereception amount generating means and the estimated size of the inputimage defined in advance by the photographing mode is larger than thememory remainders of the storage means.

[0434] Item 18:

[0435] The aforesaid control means described in the items 15 to 17transmits to the transmission side the input image stored on the storagemeans.

[0436] Item 19:

[0437] The aforesaid control means described in the item 13 or item 14controls the reception denial when the reception data is the streamingdata corresponding to the capacity obtained by the reception amountgenerating means.

[0438] Here, in this case, even if the reception of the streaming data(for example, the real time reception of conversations or some otherstreaming data) suddenly takes place during photographing, suchreception is denied completely. Therefore, the priority is given to thefulfillment of the user's intention.

[0439] Item 20:

[0440] The aforesaid control means described in the item 13 or item 14controls the amount of the reception data when the added value of thedata size of the predetermined numbers of input images, the capacityobtained by the reception amount generating means, and the estimatedsize of the input images predetermined by the photographing mode islarger than the memory remainders.

[0441] In this way, even if it is required that the communication andphotographing should coexist for the intended operation, the area neededfor the estimated numbers of images to be recorded is secured at all thetime. Therefore, the photographer is able to concentrate his attentionon photographing.

[0442] Item 21:

[0443] There is provided an image processing apparatus described in anyone of the item 6 to item 10 or an image input device described in anyone of the items 11 to 20.

[0444] Here, it becomes possible to provide a photographing apparatuscapable of implementing the compatibility of immediacy between thephotographing and communication.

[0445] Item 22:

[0446] There is provided an image processing apparatus described in anyone of the item 6 to item 10 or an image input device described in anyone of the items 11 to 20.

[0447] Here, it becomes possible to provide a photographing systemcapable of implementing the compatibility of immediacy between thephotographing and communication.

[0448] Item 23:

[0449] There is provided an image processing apparatus described in anyone of the item 6 to item 10 or an image input device described in anyone of the items 11 to 20.

[0450] Here, it becomes possible to provide a communicating devicecapable of implementing the compatibility of immediacy between thephotographing and communication.

[0451] Item 24:

[0452] There is provided an image processing apparatus described in anyone of the item 6 to item 10 or an image input device described in anyone of the items 11 to 20.

[0453] Here, it becomes possible to provide a communicating systemcapable of implementing the compatibility of immediacy between thephotographing and communication.

[0454] Item 25:

[0455] A storage medium, which is provided with the processing stepsreadable by a computer on the memory, stores the input images obtainableby being inputted by the communicating function, the reception datathrough the communicating function, and the photographing modedesignated in advance. The aforesaid processing steps comprises thesteps of compressing images to be stored on the memory by compressingthe input images with the compression ratio corresponding to thephotographing mode; generating the reception amount for obtaining therequired capacity for the data reception by the communicating function;generating remainders for obtaining the memory remainders of the memory;and controlling the compression ratio in the image compressing step inaccordance with the photographing mode, the capacity obtained in thereception amount generating step, and the memory remainders obtained inthe remainders generating step.

[0456] In this way, it is possible to heighten the compression ratio ofthe input images by changing the current photographing modes if, forexample, the added value of the required capacity (estimated receptionsize) for the data reception and the data size of the input imagespredetermined by the current photographing mode (photographing qualitymode) should be larger than the memory remainders. Therefore, it becomespossible to deal with any sudden reception during photographing, thusproviding an apparatus or a system capable of implementing thecompatibility of immediacy between the photographing and communication.

[0457] Item 26:

[0458] A storage medium, which is provided with the processing stepsreadable by a computer, stores on memory the input images obtainable bybeing inputted by the communicating function, the reception data throughthe communicating function, and the photographing mode designated inadvance. The aforesaid processing steps comprises the steps ofgenerating the reception amount for obtaining the required capacity forthe data reception by the communicating function; generating theremainders for obtaining the memory remainders of the memory;controlling the compression ratio in the image compressing step inaccordance with the photographing mode, the capacity obtained in thereception amount generating step, and the memory remainders obtained inthe remainders generating step.

[0459] In this manner, it is possible to receive only a part of theestimated reception data and heighten the compression ratio of the inputimages by changing the current photographing modes if, for example, theadded value of the required capacity (estimated reception size) for thedata reception and the data size of the input images predetermined bythe current photographing mode (photographing quality mode) should belarger than the memory remainders. Therefore, it becomes possible tomake the size of the reception data smaller to deal with any suddenreception during photographing, thus providing an apparatus or a systemcapable of implementing the compatibility of immediacy between thephotographing and communication.

[0460] Item 27:

[0461] A storage medium described in the item 26, the aforesaid thecontrolling step comprises the step of restricting the amount ofreception data if the added value of the capacity obtained in thereception amount generating step and the estimated size of input imagespredetermined by the photographing mode is larger than the memoryremainders.

[0462] Here, in this case, the amount of the reception data isrestricted by the denial of the communication during the photographingor by some other means so as to enable the photographer to materializehis intention satisfactorily.

[0463] Item 28:

[0464] The aforesaid controlling step described in the item 26 controlsthe reception denial when the reception data is the streaming datacorresponding to the capacity obtained in the reception amountgenerating step.

[0465] Here, in this case, even if the reception of the streaming data(for example, the real time reception of conversations or some otherstreaming data) suddenly takes place during photographing, suchreception is denied completely. Therefore, the priority is given to thefulfillment of the user's intention.

[0466] Item 29:

[0467] The aforesaid the controlling step described in the item 26comprises the step of restricting the amount of reception data when theadded value of the data size of the predetermined numbers of inputimages, value of the capacity obtained in the reception amountgenerating step and the estimated size of input images predetermined bythe photographing mode is larger than the memory remainders.

[0468] Here, in this case, the amount of the reception data isrestricted by the denial of the communication during the photographingor by some other means so as to enable the photographer to materializehis intention satisfactorily.

[0469] Item 28:

[0470] The aforesaid controlling step described in the item 26 controlsthe reception denial when the reception data is the streaming datacorresponding to the capacity obtained in the reception amountgenerating step.

[0471] Here, in this case, even if the reception of the streaming data(for example, the real time reception of conversations or some otherstreaming data) suddenly takes place during photographing, suchreception is denied completely. Therefore, the priority is given to thefulfillment of the user's intention.

[0472] Item 29:

[0473] The aforesaid the controlling step described in the item 26comprises the step of restricting the amount of reception data when theadded value of the data size of the predetermined numbers of inputimages, the capacity obtained by the reception amount generating step,and the estimated size of the input images predetermined by thephotographing mode is larger than the memory remainders.

[0474] In this way, even if it is required that the communication andphotographing should coexist for the intended operation, the area neededfor the estimated numbers of images to be recorded is secured at all thetime. Therefore, the photographer is able to concentrate his attentionon photographing.

[0475] Item 30:

[0476] A storage medium stores the processing step of image processingmethod according to either one of the item 1 to item 5 so as to make inreadable by a computer.

[0477] In this manner, it becomes possible to provide an apparatus or asystem capable of implementing the compatibility of immediacy betweenthe image input and the communication.

What is claimed is:
 1. An image processing method comprising the stepsof: receiving data through a net work; inputting image data obtained inaccordance with a designated input mode; managing storage of the datareceived in said receiving step and the image data inputted in saidinput step to a memory; and intervening between operations of saidreception step and said input step on the basis of said storagemanagement in said managing step.
 2. A method according to claim 1,wherein said receiving step further comprises a step of receiving datathrough wireless net work.
 3. A method according to claim 1, whereinsaid intervening step further comprises the control step of controllingthe input mode in said inputting step on the basis of said storagemanagement in said managing step.
 4. A method according to claim 1,wherein said inputting step further comprises an image inreversiblecompression step, and wherein said intervening step further comprises acontrol step for controlling a compression ratio in said compressionstep.
 5. A method according to claim 1, wherein said managing stepfurther comprises a step of managing a remaining storage capacity ofsaid memory.
 6. A method comprising the steps of: receiving data througha net work; inputting image data obtained in accordance with thedesignated input mode; managing storage of the data received in saidreceiving step and the image data inputted in said inputting step to amemory; and intervening between operations of said receiving step andsaid inputting step on the basis of said storage management.
 7. A methodaccording to claim 6, wherein said reception step further comprises astep of receiving data through wireless net work.
 8. A method accordingto claim 6, wherein said intervening step controls the inputting mode insaid inputting step in accordance with said storage management.
 9. Amethod according to claim 6, wherein said input step further comprisesan image inreversible compression step, and said intervening meanscontrols a compression ratio in said compression step.
 10. A methodaccording to claim 6, wherein said managing means manages a remainingamount of said memory.
 11. An image input apparatus having acommunicating function, and for storing into storage means data receivedby said communicating function and an image inputted in a photographingmode designated in advance, comprising: image compression means forstoring into said storage means the input image at a compression ratiocorresponding to the photographing mode; reception amount generatingmeans for obtaining a capacity required for a data reception by saidcommunicating function; remaining amount generating means for obtainingthe memory remaining amount for said storage means; and control meansfor controlling the compression ratio of said image compression means onthe basis of the capacity obtained by said reception amount generatingmeans, and the memory remaining amount obtained by said remaining amountgenerating means.
 12. An image input apparatus, comprising: input meansfor inputting a photographing mode; image input means for inputting animage obtained in the photographing mode inputted by said input means;image compression means for compressing the image inputted by said imageinput means; communicating means for receiving arbitrary data; storagemeans for storing the input image compressed by said image compressionmeans and the data received by said communicating means; remainingamount generating means for managing memory remaining amount of saidstorage means; and control means for controlling an amount of the inputimage for said image compression means on the basis of photographingmode inputted by said input means, and the memory remaining amountobtained by said remaining amount generating means.
 13. An image inputapparatus having the communicating function, and for storing intostorage means data received by said communicating function and an imageinputted in the photographing mode designated in advance, comprising:reception amount generating means for obtaining a capacity required forreceiving data by said communicating function; remaining amountgenerating means for obtaining a memory remaining amount for saidstorage means; and control means for controlling a receiving operationof said communicating function on the basis of the capacity obtained bysaid reception amount generating means, and the memory remaining amountobtained by said remaining amount generating means.
 14. An image inputapparatus, comprising: input means for inputting a photographing mode;image input means for inputting an image obtained in the photographingmode inputted by said input means; image compression means forcompressing the input image inputted by said image input means;communicating means for receiving arbitrary data; storage means forstoring the input image compressed by said image compression means andthe data received by said communicating means; remaining amountgenerating means for managing memory remaining amount of said storagemeans; reception amount generating means for obtaining a capacityrequired for receiving data by said communicating function; and controlmeans for controlling the amount of reception data of said communicatingmeans on the basis of the memory remaining amount obtained by saidremaining amount generating means, and the capacity obtained by saidreception amount generating means.
 15. An image input apparatusaccording to claim 13, wherein said control means restricts thereception data when an added value of the capacity obtained by saidreception amount generating means and an estimated size of the inputimage defined in advance in said photographing mode is larger than thememory remaining amount of said storage means.
 16. An image inputapparatus according to claim 13, wherein said control means restrictsthe amount of the reception data when an added value of the capacityobtained by said reception amount generating means and the estimatedsize of the input image defined in advance in said photographing mode islarger than the memory remaining amount of said storage means, and afterthat, a retransmission request of data is issued to a transmission side.17. An image input apparatus according to claim 13, wherein said controlmeans enables the transmission side to transmit the data having highercompression ratio when an added value of the capacity obtained by saidreception amount generating means and the estimated size of the inputimage defined in advance by said photographing mode is larger than thememory remaining amount of said storage means.
 18. An image inputapparatus according to claim 15, wherein said control means transmits toa transmission side the input image stored into said storage means. 19.An image input apparatus according to claim 13, wherein said controlmeans controls the reception denial when the reception datacorresponding to the capacity obtained by said reception amountgenerating means is streaming data.
 20. An image input apparatusaccording to claim 13, wherein said control means controls the amount ofthe reception data when the added value of the data size of thepredetermined numbers of input images, the capacity obtained by saidreception amount generating means, and an estimated size of the inputimages predetermined in said photographing mode is larger than the saidmemory remaining amount.
 21. An image pickup apparatus provided with theimage processing apparatus according to claim
 6. 22. An image pickupsystem provided with the image processing apparatus according to claim6.
 23. A communicating apparatus provided with the image processingapparatus according to claim
 6. 24. A communicating system provided withthe image processing apparatus according to claim
 6. 25. A storagemedium which stored processing steps readable by a computer, for storingon memory a communicating function, reception data by the communicationfunction, and an image inputted in a photographing mode designated inadvance, said processing steps comprising the following steps of:compressing the input image with a compression ratio corresponding tothe photographing mode and storing the compressed image; generatingreception amount for obtaining a capacity required for the datareception by said communicating function; generating remaining amountfor obtaining the memory remaining amount of said memory; andcontrolling the compression ratio in said image compressing step on thebasis of said photographing mode, the capacity obtained in saidreception amount generating step, and the memory remaining amountobtained in said remaining amount generating step.
 26. A storage mediumwhich stored the processing steps readable by a computer for storing acommunicating function, the reception data by said communicatingfunction, and an image inputted in the photographing mode designated inadvance, said processing steps comprising the following steps of:generating the reception amount for obtaining a capacity required forthe data reception by said communicating function; generating theremaining amount for obtaining the memory remaining amount of saidmemory; controlling a receiving operation by the comunication functionon the basis of said photographing mode, the capacity obtained in saidreception amount generating step, and the memory remaining amountobtained in said remaining amount generating step.
 27. A storage mediumaccording to claim 26, wherein said controlling step comprises the stepof restricting an amount of reception data when the added value of thecapacity obtained in said reception amount generating step and theestimated size of input image predetermined in said photographing modeis larger than said memory remaining amount.
 28. A storage mediumaccording to claim 26, wherein said controlling step controls thereception denial when the reception data corresponding to the capacityobtained in said reception amount generating step is streaming data. 29.A storage medium according to claim 26, wherein said controlling stepcomprises the step of restricting the amount of reception data when theadded value of the data size of the predetermined numbers of inputimages, the capacity obtained in said reception amount generating step,and the estimated size of the input images predetermined in saidphotographing mode is larger than the said memory remaining amount. 30.A storage medium which stored the processing step of image processingmethod according to either one of claim 1 to claim 5 in being readableby a computer.